Lead Data Engineer

**Atradius**

The Atradius Group provides trade credit insurance, surety and collections services worldwide, and has a presence through 160 offices in 52 countries. The products offered by Atradius protect companies around the world against the default risks associated with selling goods and services on credit.

**Overview**:
Atradius is implementing an all-new end-to-end cloud data platform and adopting a Dev/DataOps working culture.

The Lead Data Engineer will report to the Head of Data & Innovation. Working together, this experienced Data Engineer will lead and manage a team who will use knowledge of cloud-based data architecture, automated ELT and testing tools and manual coding to produce a robust, automated and efficient set of certified data pipelines to support the business.

**About you**:

- Passionate about the power of data to drive better, faster decisions
- A self-motivated learner
- Strong interpersonal and communication skills, able to work effectively with stakeholders, internal customers and technical colleagues
- Willing to challenge existing models and practices
- With a solid background in Data Engineering, you are the hands-on expert with an extensive track of record in working with Databricks and the Azure Data stack.
- You are passionate about automation and are an expert when it comes to leveraging IaaS, CI/CD pipelines and Git Branching Strategies applied to the Data Engineering space.
- You can steer the team towards quality while ensuring time to market and total cost ownership are always high up in the priorities list.
- You have a Platform as a Service mind-set and are constantly working with your clients to ensure their success in delivering value using the Data Platform components.

**Key Responsibilities**:
As the Lead Data Engineer, your tasks will be the following:

- Leading Data Engineering:

- Set the appropriate technical direction for the data engineering team to support the Product Manager, Data Platform and the data strategy
- Build and maintain a robust and efficient set of data pipelines to bring various raw data sources (internal and external) into our cloud-based storage and processing platform
- Develop and run appropriate routines, including automation, to deliver a robust and scalable service with data quality at the core
- Coach a team of Data Engineers and ensure they understand and follow best practices and develop their skills in the agreed direction
- Work with Platform Engineering, the Solutions and Data Architects to adopt best practice methodologies and maintain a data lake archive and appropriate transformed layers to support business needs
- Drive and deliver the data engineering service ownership SLAs
- Work with Platform Engineering to deliver new/custom Data Platform capabilities supported by MVPs with concrete value add to the data consumption lifecycle, as needed
- Support data governance and ensure data structures are aligned to policies and captured in the data catalogue
- Stay connected to the data management industry and constantly challenge the platform design for improvements to service, efficiency and business outcomes

Enabling data science and analytics at scale:

- Partner closely with data science and analytics teams within Data & Innovation and across the broader Atradius enterprise, understanding and developing solutions for their needs
- Ensure the data platform provides the functionality for a suitable Lab environment, developing over time as enterprise capabilities evolve
- Maintain a “Lab to Factory” process that takes data science team models into production, then constantly evaluate and retrain these models
- Prepare, maintain and make available datasets for prescriptive and predictive modelling

**Qualifications**:
Related work experience:

- 5+ years building cloud-based data engineering/data science solutions
- 2 + years leading and developing teams of Data Engineers
- Extensive technical experience of building various methods of data processing and data models using a variety of database and infrastructure types
- Experience building data structures to support first and third-party analysis under GDPR guidelines
- Experience migrating legacy physical environments to cloud-based platforms
- Experience working in a similar environment/sector (Financial Services) would be helpful

Essential Skills and Abilities:

- Fluent spoken and written English;
- Is both a strong self-starter as well as team player;
- Must be able to work under pressure when necessary;
- Self-motivated and proactive in the working environment;
- Proven ability to work with speed and accuracy to deadlines is essential;
- Has an ability to rapidly absorb new technical skills and learn new concepts quickly;
- Has a systematic, disciplined, and analytical approach to problem solving;
- Embraces diversity and proactively manages data issues;
- Ability to influence peers, team, and business stakeholders;
- The ability to build relationships and convey au