Data Engineer Lead

Build and optimize data pipelines from multiple source systems into Azure Databricks, ensuring accuracy, scalability, and alignment with enterprise architecture standards. This role involves designing, testing, and documenting ETL/ELT workflows that support marketing and analytics use cases, collaborating closely with data architects, engineers, and business stakeholders.

The ideal candidate has solid hands-on experience with Python or .NET, SQL, and Azure cloud data environments, and is comfortable working in fast-paced, cross-functional teams.

Responsibilities

• Develop and test data pipelines from MDW, DRINCC, and SFMC into Azure Databricks, following approved architectural patterns (.NET or Python).

• Implement ETL/ELT processes to support owner, prospect, and promo history data flows.

• Collaborate with solution and data architects to design file and table structures aligned with medallion architecture standards.

• Modify and optimize existing SQL scripts for profile generation, ensuring accuracy and performance.

• Contribute to source-to-target mappings, data flow diagrams, test cases, and monitoring setup.

• Work closely with Business Analysts and Engineering teams to operationalize data requirements and support production releases.

• Ensure all development follows data governance, security, and quality best practices.