Lead Data Engineer
Permanent - Full TimeJob Overview
CFC is on a journey to be a leader in data driven insurance. We are a leader in automated cyber insurance and will use data more and more as the bedrock of our business. In order to support this we are building a single data platform which will enable us to collect, share and use data across our business and with many user communities. This data platform will initially be used to support MDM requirements and over time will expand to provide core capability for leveraging data across our organisation. In order to support this initiative, we are looking to hire a Data Engineer who will play a significant role in delivering this capability.
Beyond the immediate use cases around the data platform, there are ample opportunities to influence the data approach to CFC and pioneer new initiatives to support the companies goals. We expect this role to be a mixture of hands-on development work and strategic thinking.
This is a great opportunity for an experienced data engineer to join a growing company at the forefront of data usage within the Insurance industry. You will be working with senior stakeholders to craft a new set of capabilities and have the opportunity to drive the direction and fundamentals of this platform.
About the role
What you'll be doing:
- Working with multiple stakeholder communities to understand our data needs and create pipelines to take data between different layers in the platform
- Ensuring the technical infrastructure is in place and appropriate to support managing the data platform and associated activities such as pipelines
- Creating standards and patterns to ensure that future development adhere to a high-quality fit for purpose framework
- Defining features and capabilities to move the dial on data usage within the insurance industry
- Providing governance and consultancy to users of the data platform and data related questions
About you
- 5+ years working in a Data Engineering role
- Knowledge of Python and Spark
- Strong SQL knowledge
- Experience analyzing, cleaning, migrating and modeling data
- Experience using Azure or another cloud provider (AWS, GCP)