Data Engineer

We are currently looking a Data Engineer, to join the Data Engineering team in Cardiff. You will be expected to attend the office 50% of the working week, to align with our hybrid working policy. WHO ARE WE?At Creditsafe, we weave our core values of customer-obsession, trust, respect and the courage to be different into the very fabric of our culture. With these values, we’ve fostered a culture of growth, innovation, well-being and success for the last 20 years at Creditsafe and created a legacy of successful career trajectories within our community of Creditsafers.Powering business decisions for over 100,000 business across the world requires more than just the right tools. As a company, we don’t shy away from rolling up our sleeves to do everything possible to create a welcoming environment where every new talent is guided, supported and nurtured to grow and become a part of the culture.With 25 offices across 14 countries, our geographically disperse community of colleagues are a testament to our inclusive and diverse culture that comes together to solve complex problems and learn from each other.Twice featured in The Sunday Times list of ‘100 Best Companies to Work,’ our list of successful Creditsafers who’ve created long-standing, strong career trajectories out of what started out as jobs, just keeps growing. We’re proud to be a part of a culture and a company where careers are made and where talent meet its true potential.JOB PROFILEYou will be working closely with the product, data analysts and data engineering, building specific systems facilitating the extraction and transformation of Creditsafe data. The role will define and build data pipelines that will enable faster, better, data-informed decision-making both within the business and for Creditsafe customers. This is an opportunity to gain exposure to distributed data architectures with AWSKEY DUTIES AND RESPONSIBILITIESPerform a role as part of an Agile team to develop, test and maintain high quality data processing systems that fulfil business needs. Extracting data from various data sources for example relational databases, files and API’s) Help evolve our data platform with a view towards growth and high throughput. Execute practices such as continuous integration and test driven development to enable the rapid delivery of working code. Design and build metadata driven data pipeline using Python and SQL in accordance with guidelines set by the Data Architect Ship medium to large features independently using industry standard processing patterns The responsibilities detailed above are not exhaustive and you may be requested to take on additional responsibilities deemed as reasonable by their direct line manager.SKILLS AND QUALIFICATIONS Experience designing and building autonomous fault tolerant data pipelines Solid development experience within a commercial environment creating production grade ETL and ELT pipelines in python Comfortable implementing data architectures in analytical data warehouses such as Snowflake, Redshift or BigQuery Hands on experience with data orchestrators such as Airflow Knowledge of Agile development methodologies Awareness of cloud technology particularly AWS. Knowledge of automated delivery processes Hands on experience of best engineering practices (handling and logging errors, system monitoring and building human-fault-tolerant applications) Ability to write efficient code and comfortable undertaking system optimisation and performance tuning tasks Comfortable working with relational databases such as Oracle, PostgreSQL, MySQL Has exposure to DBT and data quality test frameworks Has awareness of Infrastructure as Code such as Terraform and AnsibleBENEFITS Competitive Salary.Company Laptop supplied. Bonus Scheme.25 Days Annual Leave (plus bank holidays).Hybrid working model.Healthcare & Company Pension.Cycle to work and Wellbeing Programme.Global Company gatherings and events.E-learning and excellent career progression opportunities.Plus more that can be found on the benefits section on the Careers page, is an equal opportunities employer that values diversity. Please contact Creditsafe if there is any support you need with your application.