Data Engineering Lead

Are you ready to lead the design and development of world-class data solutions in a global insurance environment? Chubb European Group is seeking a Data Engineering Lead to architect, build, and optimize our data assets on Azure, Databricks, and Snowflake. This is a strategic, hands-on leadership role for someone passionate about data engineering, agile principles, and driving innovation through technology Key Responsibilities: Design and architect complex, scalable, and high-performance data-heavy applications on Databricks and Snowflake, applying deep expertise in database architecture, data warehouse design, and cloud computing (Azure VM, Cloud Services). Define and enforce best practices and coding standards for engineering squads, championing Agile principles and values (Scrum, Kanban) to foster team effectiveness and continuous improvement. Lead technical discussions and decision-making, guiding teams through the full development lifecycle—from discovery to go-live—while ensuring projects are delivered on time and meet rigorous quality standards. Act as the principal technical advisor for Data Engineering, collaborating with architects, developers, and product managers to deliver cohesive, impactful data products. Oversee end-to-end development, including requirement analysis, deployment, and performance tuning (DB/SQL optimization), ensuring robust, error-free applications. Mentor and guide junior and senior Data Engineers, sharing knowledge through workshops, training sessions, and comprehensive documentation of architecture, design patterns, and development processes. Promote a collaborative and innovative team environment, facilitating effective communication between technical and non-technical stakeholders. Conduct code reviews and advocate for automated testing practices, leveraging automation frameworks (Selenium, Appium, Robot Framework) and tools (Puppet, Ansible, Terraform) to ensure reliability and maintainability. Identify performance bottlenecks and implement optimizations, supporting database maintenance, backups, and disaster recovery. Stay current with industry trends, exploring and prototyping new technologies and methodologies for continuous improvement. Lead initiatives in data cleansing, curation, harmonization, and feature engineering, ensuring data quality and integration align with organizational goals. Design and implement secure, compliant data strategies, applying knowledge of data privacy, security, and regulations (GDPR, HIPAA, CCPA) to protect sensitive information. Develop and manage data pipelines/ETL processes, master data management, and open data standards for system interoperability. Apply advanced analytical skills to interpret complex data sets, build meaningful models, and drive data-driven decision-making. Bachelor’s degree or higher in Computer Science, Information Technology, or related engineering field. Extensive experience developing complex data solutions in Spark, Python, SQL, Databricks, and Snowflake. Strong understanding of software architectures for data engineering, including metadata-driven pipeline development, streaming patterns (Lambda/Kappa), and enterprise-grade observability. Proven experience leading development teams and projects, with a track record of mentoring and skill development. Excellent verbal and written communication skills, capable of conveying complex technical concepts to diverse audiences. Familiarity with agile methodologies and project management tools. Ability to foresee challenges and opportunities within the development lifecycle and plan accordingly. Strong attention to detail, flexibility to adapt to changing priorities, and a commitment to high-quality, precise work output. What we offer in return: 32 days of vacation a year 2 days working from home option + additional flexible days Working from home allowance Entry time flexibility Private medical insurance Life and accident insurance Meal allowance Pension plan Stock purchase plan Flexible compensation scheme Wellhub Employee assistance program Comprehensive Learning & Development offer Integrity. Client Focus. Respect. Excellence. Teamwork Our core values dictate how we live and work. We’re an ethical and honest company that’s wholly committed to its clients. A business that’s engaged in mutual trust and respect for its employees and partners. A place where colleagues perform at the highest levels. And a working environment that’s collaborative and supportive. Diversity & Inclusion At Chubb, we consider our people our chief competitive advantage and as such we treat colleagues, candidates, clients, and business partners with equality, fairness and respect, regardless of their age, disability, race, religion or belief, gender, sexual orientation, marital status or family circumstances. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. Equal Opportunity Statement  It is our policy to provide equal employment opportunity in all of our employment practices without regard to race, color, religion, sex, national origin, ancestry, marital status, age, individuals with disabilities, sexual orientation or gender identity or expression or any other legally protected category.  Applicants for positions with Chubb Spain must be legally authorized to work in Spain.