Apache spark jobs in New York, NYCreate job alerts

Design, develop, deploy, monitor, operate and maintain scalable streaming solutions that constitute our streaming platform. Software engineering industry experience and with distributed streaming solutions like Apache Flink, Apache Samza, Spark streaming etc. We are looking for candidates who hav...

Global hospitality company is looking for an experienced Lead PySpark Data Engineer for their Midtown NYC headquarters. Responsibilities: - Lead the in-house development of ETL/ELT data pipelines and data science projects. - Create and own data products, such as a recommendation engine or ...

Lead Software Engineer, Site Reliability (Bank Modernization) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive , and iterative delivery environment? At Capital One, you'll be part of a big group o...

In-depth experience with Apache Spark for batch and real-time data processing.Develop and maintain scalable data processing pipelines using Pyspark.Optimize and tune Pyspark jobs for performance and efficiency.Diverse Lynx LLC is an Equal Employment Opportunity employer.All qualified applicants w...

Job DescriptionJob Description We can expect quick interview here, need good profile. Already with a case of fake profile due to 2 linkedin. Job Title: Senior GCP Data Engineer Client: BGC Partners Location: Manhattan, NYC, NY (Onsite)...Local Pay Rate: $75/hr - $80/hr (C2C) Duration: 12 Month...

Job Description About Nayya Founded in 2019, Nayya is on a mission to connect people's most important information, so they can thrive in their health and wealth. Powered by AI and advanced analytics, Nayya's platform transforms complex benefits experiences into intuitive, seamless, and ongoing i...

Job Description Kunai builds full-stack technology solutions for banks, credit and payment networks, infrastructure providers, and their customers. Together, we are changing the world's relationship with financial services. At Kunai, we help our clients modernize, capitalize on emerging trends, a...

Job Description Mastech Digital provides digital and mainstream technology staff as well as Digital Transformation Services for all American Corporations. We are currently seeking an AWS Engineer for our client in the Consulting domain. We value our professionals, providing comprehensive benefits...

Job Description Are you ready to lead the charge in transforming IT systems and infrastructure? We’re looking for a Senior System Architect to join our team in New York City for an impactful 12+ month engagement with hybrid flexibility after the initial onsite period. This role is exclusively for...

Job Description Garner's mission is to transform the healthcare economy, delivering high quality and affordable care for all. By helping employers restructure their healthcare benefit to provide clear incentives and data-driven insights, we direct employees to higher quality and lower cost health...

Job Description Title: Senior GCP Data Engineer Location: New York, Onsite. USC & GC only Key Responsibilities - Design, build, and optimize end-to-end data pipelines using GCP-native services such as Dataflow, Dataproc, and Pub/Sub. - Implement data ingestion, transformation, and processin...

Job Description Garner's mission is to transform the healthcare economy, delivering high quality and affordable care for all. By helping employers restructure their healthcare benefit to provide clear incentives and data-driven insights, we direct employees to higher quality and lower cost health...

Job DescriptionCompany Description Columbia University has been a leader in higher education in the nation and around the world for more than 250 years. At the core of our wide range of academic inquiry is the commitment to attract and engage the best minds in pursuit of greater human understan...

Job DescriptionSenior Systems Architect (Contract to Hire) Duration: 12+ Months Location: Manhattan, NY (Hybrid) Interview: Video Introduction: We are seeking an experienced and dynamic Senior Systems Architect to join our team in Manhattan, NY. This is an exciting opportunity for a seasoned pro...

Job Description Garner's mission is to transform the healthcare economy, delivering high quality and affordable care for all. By helping employers restructure their healthcare benefit to provide clear incentives and data-driven insights, we direct employees to higher quality and lower cost health...

Job Description Applecart is the leading technology company creating a new category of "Decision Maker Marketing". The most important decisions are made by the hardest people to reach and influence. Historically, C-suite leaders have lacked the tools to reach the stakeholders that matter most to ...

Job Description About Nayya Founded in 2019, Nayya is on a mission to connect people's most important information, so they can thrive in their health and wealth. Powered by AI and advanced analytics, Nayya's platform transforms complex benefits experiences into intuitive, seamless, and ongoing i...

Job Description Kargo creates breakthrough cross-screen ad experiences for the world's leading brands and publishers. Every day, our 600+ employees bring the power of their creativity and diversity to radically raise the bar on what mobile, CTV, AI, social, and eCommerce can do to build businesse...

Job Description Role: GCP Data Engineers Location: ONSITE IN MANHATTAN NYC Duration: 12 Months (with strong possibility for renewal) Rate: Market Need only USC/ GC Key Responsibilities: - Design, build, and optimize end-to-end data pipelines using GCP-native services such as Dataflow, Dat...

Job Description Data Architect About Keyrock Since our beginnings in 2017, we've grown to be a leading change-maker in the digital asset space, renowned for our partnerships and innovation. Today, we rock with over 180 team members around the world. Our diverse team hails from 42 nation...

Job DescriptionCompany Description Columbia University has been a leader in higher education in the nation and around the world for more than 250 years. At the core of our wide range of academic inquiry is the commitment to attract and engage the best minds in pursuit of greater human understan...

Job Description About Nayya Founded in 2019, Nayya is on a mission to connect people's most important information, so they can thrive in their health and wealth. Powered by AI and advanced analytics, Nayya's platform transforms complex benefits experiences into intuitive, seamless, and ongoing i...

Job Description Title: Senior GCP Data Engineer Location: Onsite in Manhattan, NY Duration: 12 Months (with strong possibility for renewal) Visa : USC OR GC Key Responsibilities - Design, build, and optimize end-to-end data pipelines using GCP-native services such as Dataflow, Dataproc, ...

Job Description Kargo creates breakthrough cross-screen ad experiences for the world's leading brands and publishers. Every day, our 600+ employees bring the power of their creativity and diversity to radically raise the bar on what mobile, CTV, AI, social, and eCommerce can do to build businesse...

Job DescriptionAbout Flume Health Flume Health is a software company that connects the fragmented healthcare data ecosystem for more efficient health plan administration. As a single, cloud-native integration platform, Flume's Relay platform allows companies to easily connect various systems and ...

Job DescriptionAbout Flume Health Flume Health is a software company that connects the fragmented healthcare data ecosystem for more efficient health plan administration. As a single, cloud-native integration platform, Flume's Relay platform allows companies to easily connect various systems and ...

Job Description Garner's mission is to transform the healthcare economy, delivering high quality and affordable care for all. By helping employers restructure their healthcare benefit to provide clear incentives and data-driven insights, we direct employees to higher quality and lower cost health...

Job Title: Apache Spark Developer. Experience in Big data technologies , real time data processing platform(Spark Streaming) experience would be an advantage. Spark, Scala, Hive, SQL, Hadoop.