Apache spark jobs in Potters Bar

Getting training and hands-on experience on the latest tools and technologies such as AWS, Apache Spark, K8s, etc. Measures of success - In the first few months, you would have: * Applied sound ...

Experience working with Open table/storage formats like delta lake, apache iceberg or apache hudi ... Apache Spark. * Experience with SQL and database management systems such as Oracle, MySQL or ...

Lead Data Engineer (Director) - Individual contributor - Azure, Data Factory, Databricks, Apache Spark - London Based I am hiring for a Lead Data Engineer for a crucial role within one of my ...

Extensive experience in developing Bigdata pipelines in cloud using Bigdata technologies such as Apache Spark * Expertise in performing complex data transformation using Spark SQL queries

... Apache Spark. - Experience with SQL and database management systems such as Oracle, MySQL or PostgreSQL. - Strong understanding of data governance, data quality, data contracts, and data security ...

Experience using Apache Spark Benefits: * Salary £40-50K per annum dependant on skills and experience * 25 Days annual leave + Public Holidays * Early Finish Firdays * Performance Based Bonus

... experience with Apache Spark * Experience working with GB+ scale data * Experience with deployed ML services * Experience deploying multiple ML projects across different environments

Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. * Data acquisition and development of data sets and improving data quality * Preparing data for predictive and ...

... Apache Spark, Azure Data Factory, and other similar technologies. Other core duties include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery

... Spark, Apache Flink, or Hadoop. > Hands-on experience with cloud platforms such as AWS, Google Cloud, or Azure. > Experience with data warehousing technologies such as Redshift, BigQuery, or ...

Experience working with Apache Spark, Azure Data Factory and other data pipelines tools. * Strong programming skills. * Impeccable communication skills. * Precise attention to detail. * Pioneering ...

RESTful services, Maven/Gradle, Apache Spark, BigData, HTML 5, AngularJs/ReactJs, IntelliJ, Gitlab, Jira. * Cloud Technologies: You'll be involved in building the next generation of finance systems ...

Experience with Apache Spark or Apache Flink would be ideal, but not essential Please note, this role is unable to provide sponsorship. If this role sounds of interest and you think your skills match ...

Apache Spark jobs and pipelines. * Experience with any functional programming language. * Database design concepts. * Writing and analysing SQL queries. Application overVIOOH Our recruitment team ...

Designing and implementing scalable data pipelines using tools such as Apache Spark, Google PubSub etc. * Optimising data storage and retrieval systems for maximum performance using both relational ...

Experience working with projects in Apache Spark, Databricks of similar. * Expert cloud platform knowledge, e.g. Azure * What will be your key responsibilities? * A technical expert and leader on the ...

Proven expertise as a Data Engineer, demonstrating proficiency in Apache Spark and cloud-based technologies, particularly Microsoft Azure and Databricks. Strong programming skills, with a focus on ...

... Apache Spark. - Experience with SQL and database management systems such as Oracle, MySQL or PostgreSQL. - Strong understanding of data governance, data quality, data contracts, and data security ...

Experience with other big data and streaming technologies such as Apache Spark, Apache Flink, or Apache Beam. Knowledge of containerization and orchestration technologies such as Docker and ...

... Apache Flink (Spark Streaming, Kafka Streams, etc is also positive) - ETL development using AWS EMR and Apache Spark for batch processing. - Apache Airflow - AWS (other cloud providers to be ...

Experience designing and building ETL pipelines built around libraries and frameworks like Pandas and Apache Spark. * Strong API design skills and a familiarity with building web applications. * A ...

Strong experience with data programming frameworks such as Apache Spark. * Understanding of common Data Science and Machine Learning models, libraries and frameworks. This role provides a competitive ...

Experience working with projects in Apache Spark, Databricks of similar. * Expert cloud platform knowledge, e.g. Azure * What will be your key responsibilities? * A technical expert and leader on the ...

Data pipeline development (e.g., Airflow, Apache Spark) * SQL proficiency, database design * Visualization tools knowledge (e.g., Tableau, PowerBI, Looker) Data Engineer Application Process This is a ...