Senior/Lead Data Engineer (SC Cleared)

p strong Role title: /strong Senior & Lead Data Engineer contracts (SC Cleared) /p br Before applying for this role, please read the following information about this opportunity found below. br p strong Duration of role: /strong 6 months (potential to extend) /p p strong Location: /strong London (happy to be mostly WFH but would need to attend team meets) /p p strong Day rate: /strong £550-600 per day - INSIDE IR35 /p p strong UK based candidates with full UK residency only please /strong /p p strong Any extra Clearance required /strong /p p SC required /p p strong Paragraph about team/project the person is joining /strong /p p Data engineers in the Data Modelling and Engineering team build and maintain data pipelines to this government body's Analytical Platform from their operational services. Their analytics engineers build dimensional models on top of these data pipelines to provide useful and usable data to downstream users, including analysts, performance teams and data scientists. Over time, this is reducing dependence on manual, legacy processes that are time-consuming, error-prone and inefficient. /p p With new microservices being developed by their digital services to replace existing operational databases substantial data and analytics engineering support is required to maintain critical feeds of data to downstream applications. /p p Current models have been developed in a piecemeal manner for specific reporting requirements. Given the current scale of change, they would like to take a step back to develop a more comprehensive data model which reflects business processes and analytical needs. To build such a model they would take advantage of data linking technology and new data sources / services. /p p They are looking for an experienced, collaborative, Data Engineer to join the team to work with upstream digital teams to accelerate bringing additional microservice data onto their Analytical Platform. /p p strong Requirements /strong /p ul li Excellent python, SQL and jinja skills /li li Experience with cloud platforms, ideally AWS /li li Experience of orchestrations tools, ideally airflow /li li Experience of building CI/CD workflows, ideally with GitHub Actions /li li For Lead position - Experience of leading, enabling and supporting a team of data engineers, guiding them to apply best practices /li li Experience of ensuring practices are up to date with latest developments in data engineering /li li Experience of designing and developing data pipelines /li li Experience of working with business stakeholders and cross-functional teams /li /ul p strong Desirable /strong /p ul li Experience of infrastructure as code, ideally Terraform /li li Experience of using dbt, including implementing dbt best practices /li /ul