Senior/Lead Data Engineer

Senior/Lead Data EngineerLondon (1-2 days per week)/Remote (3-4 days per week)Salary up to £80,000 per annumAn exciting opportunity has arisen to join us here at Eden Smith in a permanent position. Due to expansion, the new Senior Data Engineer will be crucial in building robust data pipelines and data flows for our clients on Azure cloud platforms. They will work closely with our consultants and clients to understand data requirements and design, implement, and optimize data solutions to meet their business needs.Key responsibilities and accountabilities:Design, develop, and implement end-to-end data pipelines and data flows on the Azure cloud platform.Work closely with clients to understand their data requirements and translate them into technical solutions.Build and maintain scalable and efficient data storage and processing solutions using Azure services such as Azure Data Lake, Azure Synapse Analytics, Azure Databricks, and Azure SQL Database.Collaborate with cross-functional teams including data scientists, business analysts, and software engineers to integrate data solutions into existing systems and applications.Optimize data pipelines for performance, reliability, and cost-efficiency.Implement best practices for data governance, security, and compliance.Provide technical guidance and support to junior team members and clients.Stay up-to-date with the latest trends and advancements in Azure data technologies and best practices.Qualifications and skills:The successful applicant will ideally hold an Azure, or equivalent, recognised certification in solution architecture, data engineering, or data analysis.Proficient in production-level code in one or more languages, ideally SQL (T-SQL) and Python (Pyspark).Strong Snowflake experienceStrong Fivetran experienceFamiliarity with multi-cloud technologies and environments such as AWS, GCP, and Azure.Exposure to Azure data technologies, including Azure Data Factory, Data Lake, Synapse, Databricks and SQL ServerKnowledge of surrounding technologies such as BI, DevOps and governance tools.Desired industry knowledge and expertise:Experience and exposure in cross-industry, and the ability to apply learning to support problem solving.Leading/ mentoring a teamUnderstand industry-specific challenges related to data engineering and analytics.Knowledge of industry best practices that result in the development of secure, efficient and deployable code.Familiarisation with development processes, including design authorities, testing and deployments.Knowledge of CI/CD techniques and approachesExpertise in managing and handling both technical and non-technical stakeholders.This opportunity represents the chance to join a small organisation who punches well above their weight. There is room for tremendous growth and the working culture is superb.Please apply if you would like full details.