[GFA] Azure Senior Data Engineer

Project – the aim you’ll have

Our customer provides innovative solutions and insights that enable our clients to manage risk and hire the best talent. Their advanced global technology platform supports fully scalable, configurable screening programs that meet the unique needs of over 33,000 clients worldwide. Headquartered in Atlanta, GA, they have an internationally distributed workforce spanning 19 countries with about 5,500 employees. Our partner perform over 93 million screens annually in over 200 countries and territories.
We are seeking a Senior Data Engineer with solid Python/PySpark programming skills to join the Data Engineering Team and help us build the Data Analytics Platform in Azure cloud.

Position – how you’ll contribute

• Develop reusable, metadata-driven data pipelines
• Automate and optimize any data platform related processes
• Build integrations with data sources and data consumers
• Add data transformation methods to shared ETL libraries
• Write unit tests
• Develop solutions for the Databricks data platform monitoring
• Proactively resolve any performance or quality issues in ETL processes
• Cooperate with infrastructure engineering team to set up cloud resources
• Contribute to data platform wiki / documentation
• Perform code reviews and ensures code quality
• Initiate and implements improvements to the data platform architecture