Lead Data Engineer

Role Overview:

We are seeking an experienced Senior Data Engineer with 10-12 years of experience to join our Video engineering team with Gracenote - a Nielsen Company. In this role, you will design, build, and maintain our data processing systems and pipelines. You will work closely with Product managers, Architects, analysts, and other stakeholders to ensure data is accessible, reliable, and optimized for Business, analytical and operational needs.

Key Responsibilities:

● Design, develop, and maintain scalable data pipelines and ETL processes
● Architect and implement data warehousing solutions and data lakes
● Optimize data flow and collection for cross-functional teams
● Build infrastructure required for optimal extraction, transformation, and loading of data
● Ensure data quality, reliability, and integrity across all data systems
● Collaborate with data scientists and analysts to help implement models and algorithms
● Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
● Create and maintain comprehensive technical documentation
● Mentor junior engineers and provide technical leadership
● Evaluate and integrate new data management technologies and tools
● Implement Optimization strategies to enable and maintain sub second latency. Oversee Data infrastructure to ensure robust deployment and monitoring of the pipelines and processes.
● Stay ahead of emerging trends in Data, cloud, integrating new research into practical applications.
● Mentor and grow a team of junior data engineers.