Are you a business? Hire lake candidates in Wembley
Proficiency in Azure Platform, including Data Lake, Data Factory, Synapse, Logic Apps, and Function Apps etc. * SQL Server, including Store Procedures, T-SQL, or similar enterprise database toolset
Gather data from various departments and tools, integrating it into a central data lake or warehouse. * Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ...
Implement digital reports and dashboards using data from the Data Lake. * Support Monthly Reports : Provide intelligent information and analysis for monthly report production. * Training and Support
Azure experience ideally worked with tools such as Synapse, Azure Data Factory, Data Lake etc * Experience with SQL is a must, some Python is a bonus * Experience of working with a number of ...
Expertise in data analysis with exposure to data services (such as Glue, Lake Formation, EMR, EventBridge, Athena, etc.) & metadata management tools (such as Amundsen, Atlas, DataHub ...
... lake, apache iceberg or apache hudi. - Experience of developing and managing real time data streaming pipelines using Change data capture (CDC), Kafka and Apache Spark. - Experience with SQL and ...
Led projects to select, design, implement and manage data lake/data warehouse platforms. (Some of the following types of providers: AWS, Microsoft Azure, Google Cloud Platform, Databricks, Snowflake ...
In-depth knowledge and expertise of data distribution, particularly on disseminating lake-based data. * Experience with Integrating APIs. * Excellent communications skills and the ability to work ...
The role From building bespoke camps on a glacial lake to hosting parties in off-market Scottish estates and taking yachts to remote Pacific islands for world-first sub dives, Cookson Adventures has ...
This year we have key capabilities which will be released such as data intensive services and real time dashboards based on our data lake and our data gateway, in addition to complex infrastructure ...
Azure Data Factory, Azure Databricks, Databricks Lakehouse, MS Power BI, Power BI, Spark, Delta Lake, T-SQL, DevOps, ETL, Data Modelling, DAX, Data Warehousing, London
Azure Synapse/Data Lake Analytics, HDInsight. KEY RESPONSIBILITIES * Lead the productionisation of Monolith's ML models and data processing pipelines, both mid-low-level system and design and ...
... and data lake concepts and processes * Work within the team as directed to automate and improve existing data designs and data models, including relational table structures, using Unix Shell ...
Expertise with data warehousing, data lakes and data lake houses * Experience with master data management software and technologies * Experience with ETL technologies including SQL Server, SSIS ...
Data Lake and data storage design experience for both structure and unstructured data * Experience working for a consultancy or for a financial services client is required Desirable: * Data ...
Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake and other data storage solutions. * Develop robust testing and validation processes to ...
Proficiency in Microsoft Azure Data Services, including Azure SQL Database, Azure Data Factory, Azure Data Lake Storage, and Azure HDInsight. * Advanced skills in SQL programming, with the ability to ...
Strong technical experience in large distributed systems, Data Warehousing, Data Lake at scale Project management skills: financial/budget management, scheduling and resource management experience ...
Provide requirements to our data team to ensure all necessary data for analysis on FlexiPay is suitably stored within our data lake. * Proactively problem solving, identifying and confidently ...
You will be comfortable defining and building AWS infrastructure, while also able to discuss the finer details of data warehouses, lakes, lake houses and mesh architectures with client stakeholders ...
We utilize Delta Lake and PostgreSQL for data storage, emphasizing the importance of data integrity and version control in our workflows. Day-to-day, you will collaborate with the team via daily ...
Contextual Data Modelling, Entity Relationship Modelling, Logical & Physical Data Modelling and Data Lake design. * Experience designing and implementing cloud data migration and storage patterns on ...
The data is sourced from a variety of external vendors and internal departments and held in an AWS data lake, although this is being migrated to a data mesh architecture. They are working heavily ...