Data Engineering Lead - eFinancialCareers : Job Details

Our client is a global leader in Commodities Trading, with over $50 billion in revenue annually. They're looking for a Lead Data Engineer to join their global trade surveillance team and help to manage the impacts from new business initiatives.

Title: Lead Data Engineer

Salary: £100,000-£110,000

Hybrid: 2-3 x a week in Central London office

They're looking for a Lead Data Engineer to join this newly established Trade Surveillance team, to help them grow this important business area. You will managing a team consisting of local, offshore, and 3rd party resources.

Key Requirements:

• Strong Python and Pyspark experience
• Extensive experience with both Data Warehouse and Data Lakehousing is a must, in particular DataBricks, SQL, Azure Data Factory (ADF)
• Experience working within a Azure environment is essential
• Development of ETL Pipelines, working with Big Data technologies, and data architectures is required
• Automation experience e.g., PyTest
• Experience with containerized environments

Nice to Have:

• Capital Markets/Commodities Trading experience

If you have the above experience and would like to be considered for this position, please click apply now.

Please Note: Unfortunately, sponsorship is not an option for this role.