Data Lake, Lake House, and Delta Lake Experience Responsibilities: * Dynamics Specific Development, Maintenance, and Support: Developing, maintaining, and providing support for custom analytics and ...
My leading Energy and Commodities conglomerate are currently seeking a skilled individual with experience in Python-based data pipeline, data lake house development and an appreciation for Object ...
We're in search of an experienced Data Integration Manager to lead the smooth integration of data from diverse sources into our Azure Data Lake and Salesforce NFP Cloud. The ideal candidate will ...
Ingest data into an Azure Data Lake. * Design data models for large datasets, including creating dimensional multivariate models. * Utilize non-relational data storage solutions such as MongoDB
Design and fine-tune data storage and retrieval systems using Azure Data Lake Storage, Azure SQL Database, and other Azure DB services. * Develop, optimize, and maintain data pipelines for automated ...
Develop and maintain data pipelines in Azure Cloud environments, leveraging Azure Data Lake, Azure Data Factory, and Microservices architecture. * Design and implement scalable and efficient data ...
Azure Data Lake / Data Bricks / Data Factory * Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client is a ...
Lead the design, development, and implementation of data solutions using Azure services such as Spark, Data Lake, Synapse, and Databricks. * Code in Spark and oversee the technical design aspects of ...
Architect data storage solutions using Azure SQL Database, Azure Data Lake Storage, and other Azure services, ensuring scalability, reliability, and performance. Collaborate with cross-functional ...
Azure SQL Data Warehouse, Azure Data Lake,AWS S3,AWS RDS,AWS Lambda or similar * Have experience with Open Source big data products i.e.Hadoop Hive, Pig, Impala or similar * Have experience with Open ...
Data Lake & Data Mesh implementation The rewards: * negotiable basic salary and all the normal benefits you'd expect (Holiday, company pension etc.) * collaborative, open and honest environment that ...
... Lake) to enable the ingestion and provision (upstream and downstream) of traditional and alternate datasets in partnership with Quant Research and Trading teams firmwide (X-Asset - Equities, Rates ...
Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 * Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and ...
Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience * Support for Data Warehouses. * Building Azure data pipelines. * Agile methodology experience. * Problem ...
Required Experience Track record of designing and building data infrastructure and ETL pipelines Experience with Azure Platform including Data Factory, Synapse, and Data Lake DB development ...
Develop and improve solutions spanning data processing activities from the data lake (stage) to star schemas and reporting view's / tables and finally into SSAS. Desired Skills and Experience: * You ...
The Data Engineer will be predominantly responsible for setting up and configuring a new Azure Data Lake. The ideal Data Engineer will have the following skills/experience: * Proven Experience ...
Hunters utilizes an open security data lake architecture, ensuring complete and cost-effective coverage of the entire security stack. Enterprises like Booking.com, Snowflake, and ABInBev leverage ...
Strong knowledge of database and data lake systems, with proficiency in Python and SQL (any flavor). * Comfortable with shell scripting (e.g., Bash) and provisioning new infrastructure in leading ...
Implement digital reports and dashboards using data from the Data Lake. * Support Monthly Reports : Provide intelligent information and analysis for monthly report production. * Training and Support
Key Responsibilities: 1. Software Development: o Write high-quality, maintainable code using languages such as Python and SQL o Establish data tools like Snowflake and Azure Data Lake Services (ADLS ...
Azure cloud (Azure Data Factory, Azure Data Lake, Azure Data Bricks), DevOps practices/tools, Snowflake, or other relational databases, SQL, PowerBI * Ability to work both independently and within a ...
Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc * Experience with SQL is a must, some Python is a bonus * Experience of working with a number of ...
... lake, apache iceberg or apache hudi. - Experience of developing and managing real time data streaming pipelines using Change data capture (CDC), Kafka and Apache Spark. - Experience with SQL and ...