Big data developer jobs in New York, New York - Page 2Crear alertas

This full-time role offers the opportunity to work in dynamic environments centered around big data solutions. A leading technology firm in New York is looking for a skilled Python Developer with over 8 years of programming experience, including expertise in C++ and Java. The ideal candidate will ha

Join Rokt as a Data Engineer on the Metrics team, you will architect the semantic and data layers that define how Rokt measures success. Ability to partner with engineers, PMs, and GTM teams to translate ambiguous business questions into robust metric definitions and data products. Track record owni

In collaboration with other Data Engineers, Machine Learning Engineers, and Software Engineers, the candidate will empower the team of Analysts and Data Scientists to deliver data driven insights and applications across the company. Experience with Data warehouses (such as data modeling and technica

Experience with data tooling, data governance, business intelligence and data privacy is a plus. Implement best practices for data management, storage and security to ensure data integrity and compliance with regulations. Enhance the data stack, lineage monitoring and alerting to prevent incidents a

We are seeking a hands-on Senior Data Engineer to join our Data and Analytics Platform team, driving the strategy, design and implementation of our next-generation cloud-based Data Fabric and Data Mesh platform (Data Platform 2. Designing and building complex, highly scalable, reliable data pi

We're looking for a motivated Data Engineer to help build and scale our cloud-native data pipelines using Snowflake and dbt. This role is ideal for someone who enjoys solving data challenges, improving performance, and delivering trusted data to stakeholders across the business. Implement robust dat

Experience working with healthcare data (such as EHR, FHIR, HL7, or claims data) — or a strong interest in learning healthcare data systems. You’ll work with rich and diverse datasets — including EHR, prescription, and healthcare provider data — to design and maintain pipelines that help mak

Build and maintain robust ETL/ELT pipelines to ingest data from databases, third-party APIs, and external data sources. Hands-on experience with cloud data warehouses (BigQuery). Collaborate with product engineers to build data-driven features and user-facing functionality powered by analytics and a

Collaborate with ML engineers, data engineers, and software developers to deliver actionable insights and functional tools, including internal and external dashboards, APIs, and data dumps. Prepare data for further analysis, including data cleaning, transformation, anonymization, and masking. Experi

Create at least two production-grade data pipelines: Develop reliable, production-ready data pipelines to process and transform key data. Create first set of data quality SLAs: Establish initial Service Level Agreements (SLAs) for data quality to ensure reliable and accurate data across systems. Des

Strong experience with SQL and at least one modern data warehouse (Databricks, Redshift, Snowflake, BigQuery) and relational databases (Postgres, MySQL). Over time, you'll take end-to-end ownership of our data platform, setting the technical vision for data infrastructure and enabling data-driven in

Staying up to date with emerging trends and technologies in data engineering, data processing, distributed computing, and data quality assurance. Reporting to the Director of Data Engineering, you’ll work cross-functionally across the Engineering organization to emphasize designing and optimizing

You will be responsible for building out and maintaining our data infrastructure, ensuring our data stakeholders have access to high fidelity data in a timely manner, and that it’s all maintained in a high performant data warehouse. Strong Experience ingesting data from REST APIs to a data warehou

Collaborate with business analysts, data scientists, and product teams to deliver reliable data solutions. Hands-on experience with data lake/data warehouse architecture and implementation. Ingest, transform, and load large datasets from structured and unstructured sources into AWS data lakes/wareho

As a Senior Engineer on the Data Products team, you will expand Applecart’s data-mining capabilities to uncover deeper and more impactful connections within decision-maker networks. Together, you will own and enhance integrations with external APIs, large-scale batch data processing pipelines, and

Build and maintain databases to ingest and manage data for the options exchange. Strong experience in data engineering with exposure to financial services and market data. We are seeking a skilled Data Engineer to design, build, and maintain data solutions that support our options exchange.

Ensure data security and compliance with relevant data protection regulations. Develop and maintain data warehouses and data lakes to support analytics and business intelligence needs. You will work closely with data scientists, analysts, and other stakeholders to support data-driven decision-making

You’ll architect the pipelines, orchestration, and frameworks that transform Valon’s data infrastructure into a product: reliable, observable, and built for scale. This role goes far beyond traditional “data plumbing. Valon can move with precision and speed through a robust, scalable data foun

In this role, you will own and expand our numerous data pipelines and collaborate closely with our CTO and Data Lead to shape and scale our policy management platform. Contribute to ideation and experimental design, improving our model evals for data extraction and structuring, and productionizing r

Data engineers at Endex build the foundation that powers our autonomous financial analysts. You'll design and maintain the data pipelines that transform raw financial information into actionable insights for investment firms. ETL pipelines and data models that support intense analytical workflows.

Implement optimized storage solutions, including time-series databases and distributed file systems, for large-scale financial datasets. Build and maintain high-performance pipelines for market data, trade data, and analytics. Proficiency in Python and SQL with strong knowledge of database technolog

Must have 1 year of experience working with relational and non-relational databases including Postgres, MongoDB, Data modeling and database designing;. Apply knowledge of computational and data manipulation packages as well as Relational Databases and Database Design. Must have 1 year of experience

Hands-on experience with Databricks and/or Azure-based data architectures. Familiarity with observability and cost-optimization strategies for distributed data systems. Proven ability to design and optimize complex data systems for performance, scalability, and security.

We are looking for a Data Scientist to join our Garner Health Intelligence team to help build and evolve our provider data insights. You’ll work with our clinical researchers, data scientists, and data engineers to improve the rules and models we use to evaluate provider performance – e. Design

Our Data organization brings together Data Science, Business Intelligence, and Data Management to power smarter decisions and deliver meaningful impact across the business. Collaborate with BI engineers and data governance teams to ensure data integrity and consistency. Experience or coursework in d

Proven track record in ETL/ELT, data modeling, data warehouse design, development, and population from diverse data sources (databases, unstructured data, APIs). The incumbent will help us build our enterprise data warehouse on Snowflake! Your role will utilize advanced SQL and Sigma visualization a

Reporting to the Associate Director, AI/ML & Data Science, this role bridges cutting-edge data science with production-grade software, developing user-facing tools, APIs, and services that make AI models accessible and impactful. AI and machine learning are redefining how CR serves consumers—helpi

Azure cloud services, Azure Data Factory, Gen 2, Azure Databases.

Responsibilities Monitor and support daily ingestion pipelines across Azure Data Factory, Databricks Jobs, and dbt Investigate and resolve pipeline failures, data delays, and anomalies Improve pipeline reliability through: Standardized incremental and watermark logic Retry, idempotency, and recovery

The job market is challenging due to almost 300,000 tech layoffs since October 2022, due to which thousands of laid off techies are competing with existing jobseekers.Entry level job seekers struggle to get responses to their applications, forget about getting client interviews.As the saying goes, "

Deep expertise in big data frameworks like Spark, Flink, Kafka, or Janusgraph. We want to be the next big step in your career. Hands-on experience with SQL database design.

Design and manage data platforms, including Snowflake, Athena, Redshift, BigQuery, and other cloud-based solutions. This role will be responsible for architecting and maintaining multi-cloud data platforms, optimizing ETL pipelines, and ensuring data quality and availability across the organization.

Experience in designing large data distribution, integration with service-oriented architecture and/or data warehouse solutions, Data Lake solution using Azure Databricks with large and multi-format data. Experience in designing large data distribution, integration with serviceoriented architecture

A Data Engineering II works with complex data sources to extract data and automates data integration flows to create efficient processes. The role will require this person to be much higher level especially as a lead developer, need to be able to handle Design Formalization, Triage and resolve and p

Build and manage cloud data lake solutions (AWS/Databricks) for storing and retrieving large volumes of structured and unstructured data. Implement rigorous data quality, validation, and cleansing routines to ensure the accuracy of financial time-series data. Understanding of financial market data,

Data Engineering, ideally within a data-driven, multidisciplinary environment. Exceptional attention to detail in both data analysis and data engineering. As a Data Engineer, you will design, build, and maintain high-performance data systems that support the full lifecycle of research and trading:.

Must have extensive experience in working with relational databases. Experience and knowledge of equity products and instruments including FIX protocol and market/reference data. Expertise in other Database technologies like Redshift, Postgres, MongoDB would be desirable.

Hands-on expert-level knowledge in Sybase Database development. Experience in writing complex queries and generating ad-hoc reports from the database, in real-time, based on user requests. Database Management System (DBMS).

Implement approved enhancements, configuration changes, and data integrations to support evolving business needs.

Mandatory Skills: SnowSQL, SnowPipe, Big Data Model Techniques Using Python, ETL, Data Warehousing Master's Degree in Computer Science, a Related Field or Equivalent Work Experience. Certified Snowflake Cloud Data Warehouse Architect Is Preferred.

The Data Scientist II designs, develops and programs methods, processes, and systems to consolidate and analyze unstructured, diverse "big data" sources to generate actionable insights and solutions. Performs quality assurance on data to determine potential data gaps. Works with data and analytics e

Architect and implement a unified data platform that integrates hundreds of vendor datasets, providing consistent, accessible, and high-quality data to simulators and researchers. This role is central to unifying Trexquant’s extensive collection of datasets—sourced from hundreds of vendors—int

Proficient in SQL, ETL/ELT pipelines, and data modeling (Star, Snowflake, Data Vault), with hands-on experience in Microsoft Fabric, Delta Lake, Synapse, Databricks, and Azure Data Lake. Design scalable, performant data models (Star, Snowflake, Data Vault) to support BI, analytics, and operational r

Closely work with the Data Analytics and Data Platform teams to support the end-to-end design of scalable, high-performing data solutions in Snowflake using dbt. Deep understanding of Data Governance best practices and the desire + ability to lead excellent data processes across diverse teams. We ar

Experienced data modelers, SQL, ETL, with some development background to provide defining new data schemas, data ingestion for Adobe Experience Platform customers. What you'll do interface with Adobe customers to gather requirements, design solutions, and implement data models.

Data modelling and architecting skills including strong foundation in data warehousing concepts, data normalization, dimensional data modelling and a variety of data models including data vault. Demonstrated experience in Big Data, data warehouse, data analytics projects, and/or any Information Mana

Expertise in cloud data platforms (AWS, Snowflake, Databricks) and big data architecture patterns (Lambda, Kappa). Design and implement scalable, secure data architectures across cloud platforms (AWS, Databricks, Snowflake). Knowledge of data security best practices and performance optimization for

This role requires expertise in data management, knowledge of cloud platforms, relational database technologies, and data governance to build scalable and secure data systems that enable data-driven decision-making across the organization. Develop and maintain data models, data warehouses, data lake