Senior Data Engineer - Harnham - Data & Analytics Recruitment : Job Details

Role: Data Engineer

Location: London

Hybrid working: once a month

Salary: £60,000 - £70,000 (dependent on experience)

Insight into the Company:

This organisation is a rapidly growing insurance organisation that specialises in buying other companies. Although they have several thousand employees, they have a very raw data team and are looking to improve their data quality and systems. Therefore, you will be working in a small team and any experience in a start-up environment would be a great advantage!

The ideal candidate will have experience with building robust ETL pipelines and worked in Warehousing. The main project will involve migrating their system from on prem to Microsoft Fabric, with the eventual goal of building AI and ML models.

Role and Responsibilities:

• You will design, build and upgrade ETL/ ELT pipelines
• You will look to manage and optimise data infrastructure
• You will have expertise in data integration and implementing lakehouse architecture
• You will have expertise in a cloud platform - from collecting, to transforming to loading!

Skills and Experience:

• Essential to have experience with:
  • Python
  • SQL
  • A cloud platform
• Desirable to have experience with:
  • Azure
  • Bachelors in STEM subject - ideally computer science or engineering
  • Microsoft Fabric
  • CI/CD Pipelines