Lead Data Engineer – Consultant

Anticipated Contract End Date/Length: November 27, 2026
Work set up: Hybrid

Our client in the Information Technology and Services industry is looking for a Lead Data Engineer – Consultant with proven experience in leading and developing enterprise-grade data engineering platforms. This role requires deep hands-on expertise across big data ecosystems, modern data integration frameworks, and CI/CD-enabled delivery models, while promoting SRE culture, service resilience, and high-quality engineering standards in a fast-paced, global environment.

What you will do:

• Lead the design and development of enterprise data engineering platforms
• Build and optimise scalable ETL/ELT data pipelines
• Integrate large, disparate datasets using modern tools and frameworks
• Develop solutions using Hadoop, Spark, Splunk, and Python
• Handle raw, structured, semi-structured, and unstructured data across SQL and NoSQL environments
• Implement and maintain CI/CD pipelines for continuous integration, delivery, and deployment
• Collaborate with BI and Analytics teams to enable data-driven solutions
• Pair program and work closely with engineers to enhance code quality and delivery standards
• Drive the creation of technical test plans including unit and integration tests within automated environments
• Promote SRE culture by improving service resilience, sustainability, and adherence to recovery time objectives
• Represent the team in standups and technical problem-solving sessions
• Ensure control, compliance, and alignment with cybersecurity, data privacy, consent, and data residency regulations
• Engage with industry groups and vendors to represent and advance business interests
• Champion innovation and the adoption of advanced technologies and engineering best practices