Data Engineer - SC Cleared

Data Engineer - SC Cleared

Location - Northern Ireland (Belfast) If based in the UK candidates must be willing to frequently travel to Northern Ireland.

Contract - 6 Months

Day rate - �500 (Inside IR35)

Your responsibilities in the role

• Design and implement efficient data ingestion pipelines to and from databases and file storage services.
• Transform data from source to target to ensure data quality and consistency, based in agreed specifications.
• Build, maintain and optimise data pipelines to automate data flows and enable real time data processing.
• Monitor data quality and implement measures to ensure data accuracy and completeness.
• Manage and maintain databases to ensure optimal performance and security.
• Deploy and manage data infrastructure on cloud platforms - primarily AWS
• Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.

Skills and Experience

• AWS focused, Ideally a AWS Certified Data Engineer.
• SQL, Python, and Spark and experience with metadata-driven ETL/ELT.
• AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
• Version Control (Gitlab), CI/CD and IaC.
• Familiar with security and networking principles, especially in AWS deployment.
• Experience and understanding of handling both structured and unstructured data.
• Complex data migrations.
• Strong problem-solving analytical skills.
• Excellent communication and collaboration skills.
• Understanding of GIS data models.

Further information is required upon application

ECS Recruitment Group Ltd is acting as an Employment Business in relation to this vacancy.