Senior Data Engineer

Senior Data Engineer / Up to £95k + Benefits // Global Facilities Services BusinessSenior Data Engineer1 Day per Week in London Azure Stack & DataBricks Summary My client is seeking a highly skilled Senior Data Engineer to join their team. This role involves building out a robust data platform on Databricks, with a primary focus on facilitating seamless data migrations. As a Senior Data Engineer, you will leverage your expertise in Databricks and data engineering to develop scalable solutions that enhance data integration, transformation, and accessibility across the organization. Key Responsibilitiesresponsible for designing, developing, and managing data ingestion processes and pipelines within Azure and Databricks environments.The role involves utilizing Databrick's medallion architecture to create well-defined and governed data consumption models, adopting a data-as-a-product mindset.The ideal candidate will have extensive experience in cloud data engineering, a deep understanding of Azure services, and a strong proficiency in Databricks.Design, implement, and maintain scalable and efficient data pipelines for ingestion, processing, and storage of large-scale datasets using Azure and Databricks. Develop and maintain ETL processes to transform raw data into structured data sets for analysis and consumption.Implement data governance and best practices to ensure data quality, security, and compliance.Collaborate with data scientists, analysts, and other stakeholders to deliver data solutions that meet business requirements.Strong communication skillsStay up-to-date with the latest developments in Azure and Databricks, and proactively incorporate new technologies and methodologies.Exposure to large complex businesses.