Apache spark jobs in Watford

Apache Spark Application Developer Skills Required: * Hands on Experience as a software engineer in a globally distributed team working with Scala, Java programming language (preferably both

Getting training and hands-on experience on the latest tools and technologies such as AWS, Apache Spark, K8s, etc. Measures of success - In the first few months, you would have: * Applied sound ...

Getting training and hands-on experience on the latest tools and technologies such as AWS, Apache Spark, K8s, etc. Measures of success - In the first few months, you would have : * Design, implement ...

TDD, CI/CD). · Significant experience with Apache Spark or any other distributed data programming frameworks (e.g. Flink, Arrow, MapR). · Significant experience with SQL - comfortable writing ...

... Apache Spark, Azure Data Factory, and other similar technologies. Other core duties include optimizing data pipeline performance, ensuring data accuracy, reliability, and timely delivery

Data pipeline development (e.g., Airflow, Apache Spark) * SQL proficiency, database design * Visualization tools knowledge (e.g., Tableau, PowerBI, Looker) Data Engineer Application Process This is a ...

RESTful services, Maven/Gradle, Apache Spark, BigData, HTML 5, AngularJs/ReactJs, IntelliJ, Gitlab, Jira. * Cloud Technologies: You'll be involved in building the next generation of finance systems ...

Apache Spark jobs and pipelines. * Experience with any functional programming language. * Database design concepts. * Writing and analysing SQL queries. Application overVIOOH Our recruitment team ...

Ideally experience with Apache Spark or Apache Flink (but not essential) Please note, this role is unable to provide sponsorship. If this role sounds of interest and you think your skills match the ...

Designing and implementing scalable data pipelines using tools such as Apache Spark, Google PubSub etc. * Optimising data storage and retrieval systems for maximum performance using both relational ...

Strong experience with data programming frameworks such as Apache Spark. * Understanding of common Data Science and Machine Learning models, libraries and frameworks. This role provides a competitive ...

Proficient coding in - python, Apache Spark and expert knowledge of SQL and good experience with shell-scripting languages * Working knowledge of orchestration tools, e.g. Apache Airflow * Experience ...

Familiarity with cloud computing platforms (e.g., AWS, Azure, GCP) and distributed computing frameworks (e.g., Apache Spark). * Knowledge of software development best practices, version control ...

Strong experience with data programming frameworks such as Apache Spark. * Understanding of common Data Science and Machine Learning models, libraries and frameworks. This role provides a competitive ...

Experience with other big data and streaming technologies such as Apache Spark, Apache Flink, or Apache Beam. Knowledge of containerization and orchestration technologies such as Docker and ...

You will work with some of the most innovative tools in the market including Snowflake, AWS (Glue, S3), Apache Spark, Apache Airflow and DBT!! The role is hybrid, with 2 days in the office in central ...

Experience designing and building ETL pipelines built around libraries and frameworks like Pandas and Apache Spark. * Strong API design skills and a familiarity with building web applications. * A ...

Experience working with projects in Apache Spark, Databricks of similar. * Expert cloud platform knowledge, e.g. Azure * What will be your key responsibilities? * A technical expert and leader on the ...

Databricks / Apache Spark * Amazon RedShift * Azure Synapse * SQL Server * Oracle Database * Oracle Data Integrator * Oracle Integration Cloud * Business Objects Data Services (BODS) * Equivalent ...

Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc * Data acquisition and development of data sets and improving data quality * Preparing data for predictive and ...

Familiarity with Python programming language when applied to Spark and machine learning. * Familiarity with Databricks and Apache Airflow products. Required Education & Experience * Bachelor's degree ...

Lead Kafka Architect will design, perform POC where needed and develop enterprise's Apache Kafka ... Hadoop: 5+ years Kafka: 3+ years Spark: 4+ years PySpark: 3+ years

Spark, Airflow, Apache Iceberg, Arrow, DBT * Buy-side asset management (hedge fund, asset manager, investment management) Role: Python Technical Lead (Senior Architecture Programmer Developer Java ...

Spark, Airflow, Apache Iceberg, Arrow, DBT * Buy-side asset management (hedge fund, asset manager, investment management) Role: Senior Python Software Engineer (Architecture Programmer Developer Java ...