Azure Data Engineering Lead (10+ Years of Exp)
Full-timeJob Overview
Embark on an exciting journey into the realm of software product development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🌍🔥
Embark on an exciting journey into the realm of software product development with 3Pillar! We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Lead, Data Engineering, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.
If your passion for data engineering solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🌍🔥
Job Description
- Lead the design, development, and implementation of scalable data engineering solutions on the Azure platform.
- Architect and manage enterprise data platforms using Azure Data Lake (ADLS Gen2) and Microsoft Fabric (Lakehouse, Data Factory, Synapse, Power BI).
- Design and optimize ETL/ELT pipelines for structured and unstructured data using Azure-native tools.
- Build and maintain data ingestion, transformation, and orchestration pipelines using Azure Data Factory / Fabric Data Pipelines.
- Ensure data quality, security, governance, and compliance across data platforms.
- Collaborate with data scientists, analysts, and business stakeholders to deliver analytics-ready datasets.
- Lead and mentor junior data engineers, providing technical guidance and best practices.
- Optimize performance, cost, and scalability of data workflows and storage solutions.
- Implement CI/CD pipelines and follow DataOps best practices for deployment and monitoring.
- Troubleshoot production issues and drive continuous improvement across data systems.
Required Skills & Qualifications
- 10+ Years of Experience in IT Industry
- 6+ years of experience in Data Engineering, with strong expertise in Azure Data Platform.
- Hands-on experience with Azure Data Lake (ADLS Gen2) and Microsoft Fabric.
- Strong proficiency in SQL and Python for data processing and transformation.
- Experience with Azure Data Factory, Fabric Lakehouse, Synapse, and Power BI.
- Solid understanding of data warehousing concepts, data modeling, and big data processing.
- Experience implementing data security, access control, and governance in Azure.
- Familiarity with CI/CD, DevOps, and version control (Git).
- Excellent communication and leadership skills with experience leading technical teams.
Good to Have
- Azure certifications (Azure Data Engineer Associate, Fabric certifications).
- Experience with real-time data processing (Event Hub, Stream Analytics).
- Exposure to cloud cost optimization and performance tuning.
Regards
Rajan Paul(Linkedin Profile)
Talent Acquisition
3Pillar Global