Lead Big Data Engineer - Henderson Scott : Job Details

Lead Big Data Engineer Salary: £94,000 DOELocation: London (4 days a week on site)** MUST HOLD AN ACTIVE DV CLEARANCE ** Benefits: Health care, dental, flexible working, critical illness cover, health assessments and annual incentive programme.As the Lead Big Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our big data architecture. You will work with the wider teams to ensure seamless data integrationResponsibilities:

• Develop and maintain scripts for automation processes and work flows
• Conduct thorough testing to ensure seamless integration
• Data pipeline support by managing and optimising
• Utilise detailed knowledge of Linux internals
• Troubleshooting by diagnosing and resolving technical issues
• Following network protocols
• Design scalable big data systems
• Data pipeline support
• Hybrid cloud management
• Implement and support business intelligence and visualisation tools
• Utilise big data NoSQL engines and platforms

Requirements:

• Experience with Python /Bash
• Strong troubleshooting skills
• Strong understanding of TCP/ IP and OSI Models proven experience with integration testing
• Strong knowledge of Linux internals
• Experience working in AWS Cloud environment's
• Big data NoSQL
• Experience AI tools such as Jupyter / Spacy
• Business intelligence tools like Tableau/ Power BI
• AWS Certification (desirable)
• Big data tools and technologies. Hadoop/ Cloudera (desirable)

If you have the required skills set, and this role is of interest please apply online or email