Apache spark jobs in Nutley, New Jersey (NJ) State

Designing and implementing large-scale, distributed data processing systems using technologies such as Apache Hadoop, Apache Spark, or Apache Flink. Developing and optimizing data pipelines and ...

Implement data processing and transformation workflows using Databricks, Apache Spark, and SQL to support analytics and reporting requirements. * Build and maintain orchestration workflows using ...

Experience working with leading-edge distributed database solutions like Apache Spark, Apache Arrow, Dremio, Databricks, and similar tools. * Experience customising analytical and visualisation tools ...

Strong knowledge of data manipulation languages such as Spark, Scala, Impala, Hive SQL, Apache Nifi and Kafka necessary to build and maintain complex queries, streaming, and real-time data pipelines

Apache Spark; Splunk; GIT; Junit; Blackbox Testing; Functional Testing; Manual Testing; Performance Testing; Regression Testing; Smoke Testing; System Integration Testing; Unit Testing; User ...