Data Engineering Manager

Design, implement, and maintain scalable data pipelines and ETL jobs for processing and transferring large data volumes.

Manage data ingestion from multiple external sources (e.g., pharmacy data) through AWS cloud environments to client on-premise servers.

Collaborate with cross-functional teams to ensure data governance, quality, and security.

Oversee and mentor a team of Data Engineers, ensuring adherence to best practices in development and deployment.

Define architecture using AWS CDK and CloudFormation for infrastructure as code.

Partner with clients to gather requirements, assess business goals, and deliver tailored data solutions.

Integrate and optimize tools such as Snowflake, Databricks, and Lake Formation for advanced data processing.

Implement data clean rooms and support privacy-compliant data-sharing solutions.

Monitor data workflows, troubleshoot issues, and ensure high availability of systems.

Stay current on modern data engineering technologies and recommend improvements.