Data Engineer Lead

hace 3 semanas

Barcelona, España Merlin Digital Partner A tiempo completo

We are **Merlin Digital Partner** A** leading IT and Digital headhunting company** who stands out from the crowd, boasting over a decade of experience. We've** successfully collaborated and played a pivotal role in the growth of industry heavyweights **such as Wallapop, Glovo, Banc Sabadell, and Factorial, among others.

Our **emphasis lies in people-centric approaches and optimizing the selection processes**. Our **mission is to revolutionize companies by seamlessly integrating top-tier talent**. What sets us apart is our** in-depth understanding of each partner** (being their best influencer), addressing not only their needs but also capturing their essence.

We are currently seeking a **Data Engineer** **Lead** to work with one of our partners, under contract with Merlin (maximum one year with possible client incorporation thereafter).

Our partner, a major multinational in the consumer goods sector, operates in a fast-changing environment, driven by big data and digital technologies that are transforming the business and generating innovations in areas such as e-commerce and IoT. They are looking to optimize enterprise data within the Data Operations team to achieve agility in decision-making

As the **Data Engineering Manager**, you will be the key technical expert responsible for overseeing the construction and operations of our partner's data products, and leading a strong vision on how data engineering can proactively create a positive impact on the business

**The Role**:

- Provide leadership and management to a team of data engineers, managing processes and their flow of work, vetting their designs, and mentoring them to realize their full potential.
- Oversee work with internal clients and external partners to structure and store data into unified taxonomies and link them together with standard identifiers.
- Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products.
- Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance.
- Responsible for implementing best practices around systems integration, security, performance and data management.
- Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape.
- Evolve the architectural capabilities and maturity of the data platform by engaging with enterprise architects and strategic internal and external partners.
- Develop and optimize procedures to “productionalize” data science models.
- Define and manage SLA’s for data products and processes running in production.
- Support large-scale experimentation done by data scientists.
- Prototype new approaches and build solutions at scale.
- Research in state-of-the-art methodologies.
- Create documentation for learnings and knowledge transfer.
- Create and audit reusable packages or libraries.

**Please, consider applyng if you have**:

- 8 years of overall technology experience that includes at least 6 years of hands-on software development, data engineering, and systems architecture.
- 6 years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools.
- 6 years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.).
- 4 years in cloud data engineering experience in at least one cloud (Azure, AWS, GCP).
- Fluent with Azure cloud services. Azure Certification is a plus.
- Experience scaling and managing a team of engineers.
- Experience with integration of multi cloud services with on-premises technologies.
- Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines.
- Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations.
- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
- Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake.
- Experience with version control systems like Github and deployment & CI tools.
- Experience with Azure Data Factory, Azure Databricks and Azure Machine learning tools.
- Experience with Statistical/ML techniques is a plus.
- Experience with building solutions in the retail or in the supply chain space is a plus
- Understanding of metadata management, data lineage, and data glossaries is a plus.
- Working knowledge of agile development, including DevOps and DataOps concepts.
- Familiarity with business intelligence tools (such as PowerBI).
- BA/BS in Computer Science, Math, Physics, or other technical fields.
- Preferably some experience in the Consumer Goods Industry
- **Any experience, passion for / interest in Corporate Social Responsibility & Sustainability topics (spanning agriculture, climate, water, packagi

  • Lead Data Engineer

    hace 1 mes

    Barcelona, España AstraZeneca A tiempo completo

    **LEAD DATA ANALYTICS ENGINEER** **ABOUT THE OPERATIONS IT TEAM** Operations IT is a global IT capability supporting the Global Operations organisation. We business partner with Operations capability areas: Pharmaceutical Technology Development, Manufacturing & Global Engineering, Quality Control, Sustainability, Supply Chain, Logistics and Global External...

  • Lead Data Engineer

    hace 4 semanas

    Barcelona, España Morgan Philips Executive Search A tiempo completo

    Pharmaceutical company is looking for a Lead Data Engineer to join our Data, Analytics & AI (DA&AI) team in Operations IT. As part of our ground-breaking journey in Data DA&AI within Operations IT, we are advancing our Operation Data Hub (ODH) and adopting the Data Mesh architecture and ways of working. **Responsibilities**: Provide detailed design, aligned...

  • Data Center Engineer

    hace 4 semanas

    Barcelona, España ConexusDX A tiempo completo

    **Job description**: Conexus is proud to be partnering with a Global Chemicals company and we are looking for a highly motivated Data Center Engineer to join our team on a 6-month contract, with the possibility of extension based on project requirements. - As a Data Center Engineer, you will be responsible for managing and maintaining the company's data...

  • Data Integration Engineer

    hace 3 semanas

    Barcelona, España Hitachi Vantara Corporation A tiempo completo

    Description We are looking for an experienced Data Integration Engineer to join our team. The ideal candidate will have a passion for developing and maintaininghigh-quality data processing and integration solutions using modern technologies.Design, develop, and maintain SQL code.Bring 100k LoC codebase into SDLC (including version control and testing)Ensure...

  • Data Integration Engineer

    hace 3 semanas

    Barcelona, España Hitachi A tiempo completo

    DescriptionWe are looking for an experienced Data Integration Engineer to join our team. The ideal candidate will have a passion for developing and maintaining high-quality data processing and integration solutions using modern technologies.Design, develop, and maintain SQL code. Bring 100k LoC codebase into SDLC (including version control and testing)...

  • Data Engineer, hibrido

    hace 2 semanas

    Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo. data, Scala, PowerShell,

  • Data Engineer, Hibrido

    hace 3 semanas

    Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido. Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo. data, Scala, PowerShell,

  • Data Engineer, hibrido

    hace 3 semanas

    Barcelona, Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo.data, cala, PowerShell, data, cala, PowerShell,

  • Lead Data Engineer

    hace 4 semanas

    Barcelona, España Two Circles A tiempo completo

    Two Circles is a data-driven sports consultn. We work with some of the world’s biggest sports organisations - including the NFL, Premier League, Formula 1, Wimbledon and UEFA - and have three times been named Sport Industry Agency of the Year. Every day, our team analyses billions of pieces of behavioural, attitudinal and purchase data from sports fans...

  • Data Science Engineer

    hace 1 mes

    Barcelona, España TEC Partners A tiempo completo

    Job Type: Permanent Sector: Technology Seniority: Junior Essential skils: Data, Python, Software Engineering, Retail, Research, Science Location: Barcelona Region: Catalonia Salary: Negotiable **Data Science Engineer** - Permanent Role - Minimum 2 years - Barcelona Based** TEC Partners is looking for a Data Science Engineer to join my clients Data...

  • Lead Expert Data Engineer

    hace 4 semanas

    Barcelona, España Merck Kgaa, Darmstadt, Germany A tiempo completo

    we are looking for a Lead Expert Data Engineer to implement Process Mining technology to enhance business processes. The role involves collaborating with internal customers, functional and digital experts, and stakeholders in the Finance area to translate use cases into effective, scalable, and agile solutions. It also entails working with IT to automate and...

  • Data Engineer

    hace 1 mes

    Barcelona, España Coders Connect A tiempo completo

    **Coders Connect** are partnering with **Sanofi**. Consumer Healthcare is becoming a standalone division within Sanofi in order to become a faster moving, consumer and customer centric business as part of project CHLOE (Consumer HealthCare Lead Optimize Empower). This business and IT transformation will entail a standalone ERP, Financial, Systems,...

  • Data Engineer

    hace 3 días

    Barcelona, España Product and Technology A tiempo completo

    Opportunity Are you a seasoned Data Engineer with a passion for travel and a track record of leveraging data-driven insights to enhance customer experiences and drive business growth? Join our fast paced environment at WhereTo as a Level III Data Engineer and play a pivotal role in shaping the future of travel through data analysis and innovation.  A...

  • Data Engineer

    hace 3 días

    Barcelona, España Studentuniverse A tiempo completo

    Update your details, view your application and progress >> Login Job search Job search e.g. "Administrator, Melbourne" Refine searchWork typeRegionLocationBrandCategory Apply now Job no: 520242 Brand: Product and Technology Work type: Full time Location: Spain - Barcelona Categories: Information & Technology WhereTo provides an AI-powered travel...

  • Sr. Data Engineer

    hace 3 semanas

    Barcelona, España Merlin Digital Partner A tiempo completo

    We are Merlin Digital Partner! A leading IT and Digital headhunting company who stands out from the crowd, boasting over a decade of experience. We've successfully collaborated and played a pivotal role in the growth of industry heavyweights such as Wallapop, Glovo, Banc Sabadell, and Factorial, among others. Our emphasis lies in people-centric approaches...

  • Data Engineer

    hace 1 semana

    Barcelona, España Itjobs A tiempo completo

    At CGI we are looking for a Data Engineer with Palantir.Requirements:- More than 2 years of experience in the architecture of data solutions developed in the cloud.- Palantir Certification- Python/PySpark for Data Engineer- Knowledge of data management fundamentals and data warehousing principles.- Demonstrated strength in data modelling, ETL and...

  • Data Integration Engineer

    hace 1 mes

    Barcelona, España HITACHI ENERGY SPAIN, S.A.U. A tiempo completo

    Description : We are looking for an experienced Data Integration Engineer to join our team. The ideal candidate will have a passion for developing and maintaininghigh-quality data processing and integration solutions using modern technologies.  Design, develop, and maintain SQL code. Bring 100k LoC codebase into SDLC (including version control...

  • Data Engineer

    hace 2 semanas

    Barcelona, España Krell Consulting & Training A tiempo completo

    Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell, así como en Big Data y desarrollo de software, con al menos 7 años de experiencia en el campo.

  • Lead Data Engineer

    hace 2 semanas

    Barcelona, España Bitpanda Gmbh A tiempo completo

    Your missionDo you want to develop data pipelines and do innovative work on the data processing frameworks and architectures with the ability to scale intelligently? Then join the Bitpanda Data Platform Engineering team! What you'll doOpportunity to build and define the data initiatives for the companyBuild the infrastructure required for optimal extraction,...

  • Data Engineer

    hace 2 semanas

    Barcelona, Barcelona, España Krell Consulting & Training A tiempo completo

    Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell, así como en Big Data y desarrollo de software, con al menos 7 años de experiencia en el campo.