Data Engineer for Advanced Data Pipelines and Automation

hace 3 semanas


Barcelona, Barcelona, España Bayer A tiempo completo
About the Role

At Bayer, we're driven to solve the world's most complex challenges and make a real difference. As a Senior Data Engineer in our Vegetable R&D Engineering and Automation Hub, you'll play a crucial role in developing and maintaining key projects that improve operational efficiency and support predictive breeding.

We're seeking a talented individual with strong technical engineering skills and experience working with Big Data technologies like Google BigQuery. You'll be responsible for designing, developing, and maintaining scalable ETL pipelines using Metaflow and Python, as well as implementing Kafka-based streaming data pipelines and managing cross-cloud data synchronization processes.

Key Responsibilities
  • Design and develop scalable ETL pipelines using Metaflow and Python
  • Implement Kafka-based streaming data pipelines and manage cross-cloud data synchronization processes
  • Oversee database management by optimizing SQL queries, implementing effective indexing strategies, and conducting regular performance tuning
  • Establish materialized views for performance optimization and create data quality checks and validation procedures
  • Monitor, troubleshoot, and document data pipeline issues, implementing error handling and recovery mechanisms as needed
Requirements

To be successful in this role, you'll need:

  • Bachelor's degree in computer science, software engineering, or a related discipline plus minimum of 5 years of experience
  • Proven experience building large-scale data pipelines for production applications
  • History of working in Agile Scrum teams
  • Strong expertise in Python and SQL, with advanced skills in data modeling and database design
  • Proven experience in SQL optimization, database performance tuning, and using materialized views for enhanced efficiency
About the Team

You'll be part of a diverse and global team of scientists, engineers, developers, plant breeders, and IT professionals working together to drive innovation and growth. We offer a dynamic and supportive work environment, opportunities for professional development, and a competitive salary package.

Location

This position is based in Spain, specifically in Barcelona.

Salary Range

The estimated salary for this role is between €80,000 and €110,000 per year, depending on experience and qualifications.


  • Data Pipeline Engineer

    hace 2 semanas


    Barcelona, Barcelona, España Allianz Popular A tiempo completo

    **Job Overview**We are seeking a skilled Data Pipeline Engineer to join our team at Allianz Popular. This role involves designing and developing data-driven applications that deliver unprecedented visibility over our multi-billion-euro portfolio of expenditure.About the JobAs a Data Pipeline Engineer, you will oversee the development of enterprise-grade...


  • Barcelona, Barcelona, España Roadsurfer Gmbh A tiempo completo

    **About Roadsurfer Gmbh**We are a dynamic company that values team spirit, flexibility, and personal development. Our Data team plays a crucial role in aligning our strategies with business priorities.**The Role - Your Passion**We are looking for an experienced Data Engineer to join our team and contribute to developing and maintaining data pipelines using...

  • Data Pipeline Architect

    hace 20 horas


    Barcelona, Barcelona, España roadsurfer A tiempo completo

    About Roadsurfer">We are a fast-growing team with ambitious goals and a great team spirit. Our vision is to shape the future of outdoor travel and build an ecosystem for sustainable outdoor travel.">Our Team">As a Data Engineer at Roadsurfer, you will be part of our strategic leader's team, responsible for aligning the company's strategies with our team's...


  • Barcelona, Barcelona, España Data Science Festival A tiempo completo

    **Company Overview:**Data Science Festival is a leading retail brand in the UK seeking an experienced Staff Data Engineer to support their data transformation initiatives.**Job Description:**Azure-Powered Data Pipeline Developer:As a key member of the data team, you will design and implement robust data pipelines using Python, Spark, and Azure to deliver...


  • Barcelona, Barcelona, España Edreams A tiempo completo

    Company OvervieweDreams ODIGEO is a leading travel tech company, revolutionising the travel booking experience through consumer insight, innovative technology, market leadership, and Prime, the world's first travel subscription program.We're a global business with 20 million customers, 44 markets, 5 brands, and over 1400 employees from more than 50 different...


  • Barcelona, Barcelona, España Institute for Bioengineering of Catalonia (IBEC) A tiempo completo

    About the PositionThe Institute for Bioengineering of Catalonia (IBEC) is seeking an exceptional Data Management Engineer to join its Nonlinear Photonics for Neuroscience Research Group. This exciting opportunity involves leading the development of cutting-edge data management systems, acquisition protocols, and advanced analysis pipelines critical for...


  • Barcelona, Barcelona, España Daniel J. Edelman Holdings A tiempo completo

    Senior Data Engineer Position OverviewWe are seeking an experienced Senior Data Engineer to join our team at Daniel J. Edelman Holdings, where you will play a key role in designing and implementing scalable data pipelines to support advanced analytics and machine learning models.About the RoleThis is a challenging opportunity for a highly skilled Data...

  • Data Architect

    hace 20 horas


    Barcelona, Barcelona, España Data Bene A tiempo completo

    **Company Overview:**At Data Bene, we are a leading provider of innovative data solutions. Our team of experts is dedicated to helping our clients unlock the full potential of their data.**Job Description:**We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and developing our data...

  • Data Engineering Leader

    hace 3 semanas


    Barcelona, Barcelona, España Data Bene A tiempo completo

    About Data BeneAt Data Bene, we are seeking a skilled Data Engineer Leader to join our team. This is an exciting opportunity for an experienced professional to lead the design and development of automated data pipelines, implement best practices for data analytics, and oversee data model solutions.About the RoleWe estimate this position comes with a salary...

  • Data Engineering Leader

    hace 4 semanas


    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    Ecf Data, LLC is seeking a highly skilled Data Engineer to join our team. The ideal candidate will have exceptional attention to detail and advanced computational skills, with the ability to rapidly develop and act upon in-depth knowledge of our business, products, and processes.The estimated salary for this position is $120,000 - $180,000 per year,...


  • Barcelona, Barcelona, España Data Science Festival A tiempo completo

    About the RoleA senior data analytics professional to lead advanced data science solutions in a FinTech organization. You will join a collaborative team of experts to build cutting-edge models using financial scorecards and leverage NLP and Machine Learning for future projects.Key Responsibilities- Collaborate with cross-functional teams to design and...

  • Data Engineer Lead

    hace 3 semanas


    Barcelona, Barcelona, España Roadsurfer GmbH A tiempo completo

    Job DescriptionWe are seeking an experienced Senior Data Engineer to lead our data engineering efforts and develop scalable data infrastructure on Google Cloud BigQuery.The ideal candidate will have a strong focus on building and maintaining data pipelines, as well as extensive experience with cloud-based data warehousing solutions. Additionally, the...


  • Barcelona, Barcelona, España Novartis Farmacéutica A tiempo completo

    Novartis is seeking an experienced Global Cybersecurity Engineer to join our CSOC team in Prague, Czech Republic and Barcelona, Spain. The ideal candidate will have a strong background in data pipeline engineering and experience with SIEM platforms such as Sentinel and Splunk.The successful candidate will design, develop, implement, and manage dataflow...


  • Barcelona, Barcelona, España Team A tiempo completo

    Job Description:As a Data Engineer at Team, you will play a key role in developing and maintaining our central data warehouse. This involves designing, developing, and maintaining scalable data pipelines to ingest, process, and transform large volumes of structured and unstructured data from various sources. About the Company:Team is an ecosystem of 60+...


  • Barcelona, Barcelona, España MAM Gruppe A tiempo completo

    Data Platform Engineer Job DescriptionWe are seeking an experienced Senior Data Platform Engineer to join our team at MAM Gruppe. As a Senior Data Platform Engineer, you will be responsible for designing and delivering the core infrastructure for our transformative platform. Your key responsibilities will include designing and building a scalable,...

  • Data Architect

    hace 2 semanas


    Barcelona, Barcelona, España Data Bene A tiempo completo

    Job OverviewData Bene is seeking a highly skilled Data Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and developing large-scale data pipelines and architectures.


  • Barcelona, Barcelona, España Splio A tiempo completo

    OverviewSplio is a leading SaaS marketing platform that integrates CDP and Marketing Automation, along with essential CRM features. With over 200 employees across Europe and MEA, we offer a unique opportunity to grow your career in a dynamic environment.Job SummaryWe are seeking an experienced Engineering Manager to lead our Data Processing & Metrics team....


  • Barcelona, Barcelona, España Stayforlong A tiempo completo

    Company OverviewStayforlong is a travel company that values prolonged stays and empowering customers to break free from industry constraints. Founded in Barcelona in 2015, we strive to offer a fresh perspective and flexibility to our customers, hoteliers, and partners.About the TeamWe are a dynamic and collaborative team of 80 people who believe in equal...


  • Barcelona, Barcelona, España Quantion A tiempo completo

    Company OverviewQuantion is a Business Digital Transformation services company founded in 2015. With over 120 professionals in application development, UX/UI, and digital business transformation, we create innovative solutions focused on business results.We combine our cutting-edge technology teams with the innovation ecosystem to deliver the best solutions...


  • Barcelona, Barcelona, España roadsurfer A tiempo completo

    About #RoadsurferWe are an open, fast-growing team with ambitious goals and a great team spirit. We combine a brutal hands-on mentality with fun at work, shaping the future of outdoor travel and building an ecosystem for sustainable outdoor travel. Our products include rent, abo, sales, and roadsurfer spots – a platform where you can discover and book...