[Job-28122] Senior Data Engineering
HomeofficeJob Overview
We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
Responsibilities:
- Design and Develop Data Pipelines: Create robust, scalable data pipelines using Databricks, Apache Spark, and SQL to transform and process large datasets efficiently.
- Performance Optimization: Monitor and optimize the performance of existing data pipelines and workflows to ensure high throughput and low latency.
- Collaboration with Stakeholders: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical specifications.
- Data Quality and Governance: Implement data quality checks and governance practices to ensure data consistency, accuracy, and compliance.
- Documentation and Best Practices: Maintain comprehensive documentation for data pipelines and processes, and contribute to the establishment of best practices within the team.
Requirements for this Challenge:
- Sólid experience in data engineering or a related field, with a focus on data pipelines
- Soft Skills: Excellent communication in English and Portuguese, with the ability to work effectively in a team-oriented environment and engage with clients.
- Technical Skills: Proficiency in Databricks, Apache Spark, SQL, and Python (or Scala).
- Cloud Technologies: Experience with cloud Azure
- Problem-Solving: Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues.
- Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
We are tech transformation specialists, uniting human expertise with AI to create scalable tech solutions.
With over 8,000 CI&Ters around the world, we’ve built partnerships with more than 1,000 clients during our 30 years of history. Artificial Intelligence is our reality.
Responsibilities:
- Design and Develop Data Pipelines: Create robust, scalable data pipelines using Databricks, Apache Spark, and SQL to transform and process large datasets efficiently.
- Performance Optimization: Monitor and optimize the performance of existing data pipelines and workflows to ensure high throughput and low latency.
- Collaboration with Stakeholders: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical specifications.
- Data Quality and Governance: Implement data quality checks and governance practices to ensure data consistency, accuracy, and compliance.
- Documentation and Best Practices: Maintain comprehensive documentation for data pipelines and processes, and contribute to the establishment of best practices within the team.
Requirements for this Challenge:
- Sólid experience in data engineering or a related field, with a focus on data pipelines
- Soft Skills: Excellent communication in English and Portuguese, with the ability to work effectively in a team-oriented environment and engage with clients.
- Technical Skills: Proficiency in Databricks, Apache Spark, SQL, and Python (or Scala).
- Cloud Technologies: Experience with cloud Azure
- Problem-Solving: Excellent analytical and problem-solving skills, with the ability to troubleshoot complex data issues.
- Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
Our benefits:
-Health and dental insurance
-Meal and food allowance
-Childcare assistance
-Extended paternity leave
-Partnership with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
-Profit Sharing and Results Participation (PLR);
-Life insurance
-Continuous learning platform (CI&T University);
-Discount club
-Free online platform dedicated to physical, mental, and overall well-being
-Pregnancy and responsible parenting course
-Partnerships with online learning platforms
-Language learning platform
And many more!
More details about our benefits here: https://ciandt.com/br/pt-br/carreiras
At CI&T, inclusion starts at the first contact. If you are a person with a disability, it is important to present your assessment during the selection process. See which data needs to be included in the report by clicking here.This way, we can ensure the support and accommodations that you deserve. If you do not yet have the assessment, don't worry: we can support you in obtaining it.
We have a dedicated Health and Well-being team, inclusion specialists, and affinity groups who will be with you at every stage. Count on us to make this journey side by side.