Data Engineer for Advanced Data Pipelines and Automation
hace 3 semanas
At Bayer, we're driven to solve the world's most complex challenges and make a real difference. As a Senior Data Engineer in our Vegetable R&D Engineering and Automation Hub, you'll play a crucial role in developing and maintaining key projects that improve operational efficiency and support predictive breeding.
We're seeking a talented individual with strong technical engineering skills and experience working with Big Data technologies like Google BigQuery. You'll be responsible for designing, developing, and maintaining scalable ETL pipelines using Metaflow and Python, as well as implementing Kafka-based streaming data pipelines and managing cross-cloud data synchronization processes.
Key Responsibilities- Design and develop scalable ETL pipelines using Metaflow and Python
- Implement Kafka-based streaming data pipelines and manage cross-cloud data synchronization processes
- Oversee database management by optimizing SQL queries, implementing effective indexing strategies, and conducting regular performance tuning
- Establish materialized views for performance optimization and create data quality checks and validation procedures
- Monitor, troubleshoot, and document data pipeline issues, implementing error handling and recovery mechanisms as needed
To be successful in this role, you'll need:
- Bachelor's degree in computer science, software engineering, or a related discipline plus minimum of 5 years of experience
- Proven experience building large-scale data pipelines for production applications
- History of working in Agile Scrum teams
- Strong expertise in Python and SQL, with advanced skills in data modeling and database design
- Proven experience in SQL optimization, database performance tuning, and using materialized views for enhanced efficiency
You'll be part of a diverse and global team of scientists, engineers, developers, plant breeders, and IT professionals working together to drive innovation and growth. We offer a dynamic and supportive work environment, opportunities for professional development, and a competitive salary package.
LocationThis position is based in Spain, specifically in Barcelona.
Salary RangeThe estimated salary for this role is between €80,000 and €110,000 per year, depending on experience and qualifications.
-
Data Pipeline Engineer
hace 2 semanas
Barcelona, Barcelona, España Allianz Popular A tiempo completo**Job Overview**We are seeking a skilled Data Pipeline Engineer to join our team at Allianz Popular. This role involves designing and developing data-driven applications that deliver unprecedented visibility over our multi-billion-euro portfolio of expenditure.About the JobAs a Data Pipeline Engineer, you will oversee the development of enterprise-grade...
-
Data Engineer for Data Pipelines and Customer Insights
hace 4 semanas
Barcelona, Barcelona, España Roadsurfer Gmbh A tiempo completo**About Roadsurfer Gmbh**We are a dynamic company that values team spirit, flexibility, and personal development. Our Data team plays a crucial role in aligning our strategies with business priorities.**The Role - Your Passion**We are looking for an experienced Data Engineer to join our team and contribute to developing and maintaining data pipelines using...
-
Data Pipeline Architect
hace 20 horas
Barcelona, Barcelona, España roadsurfer A tiempo completoAbout Roadsurfer">We are a fast-growing team with ambitious goals and a great team spirit. Our vision is to shape the future of outdoor travel and build an ecosystem for sustainable outdoor travel.">Our Team">As a Data Engineer at Roadsurfer, you will be part of our strategic leader's team, responsible for aligning the company's strategies with our team's...
-
Data Engineer for Retail Data Transformation
hace 4 semanas
Barcelona, Barcelona, España Data Science Festival A tiempo completo**Company Overview:**Data Science Festival is a leading retail brand in the UK seeking an experienced Staff Data Engineer to support their data transformation initiatives.**Job Description:**Azure-Powered Data Pipeline Developer:As a key member of the data team, you will design and implement robust data pipelines using Python, Spark, and Azure to deliver...
-
Data Engineer for Large Scale Data Pipelines
hace 3 semanas
Barcelona, Barcelona, España Edreams A tiempo completoCompany OvervieweDreams ODIGEO is a leading travel tech company, revolutionising the travel booking experience through consumer insight, innovative technology, market leadership, and Prime, the world's first travel subscription program.We're a global business with 20 million customers, 44 markets, 5 brands, and over 1400 employees from more than 50 different...
-
Data Management Engineer for Advanced Neuroscience Research
hace 4 semanas
Barcelona, Barcelona, España Institute for Bioengineering of Catalonia (IBEC) A tiempo completoAbout the PositionThe Institute for Bioengineering of Catalonia (IBEC) is seeking an exceptional Data Management Engineer to join its Nonlinear Photonics for Neuroscience Research Group. This exciting opportunity involves leading the development of cutting-edge data management systems, acquisition protocols, and advanced analysis pipelines critical for...
-
Data Engineering Leader for Advanced Analytics
hace 7 días
Barcelona, Barcelona, España Daniel J. Edelman Holdings A tiempo completoSenior Data Engineer Position OverviewWe are seeking an experienced Senior Data Engineer to join our team at Daniel J. Edelman Holdings, where you will play a key role in designing and implementing scalable data pipelines to support advanced analytics and machine learning models.About the RoleThis is a challenging opportunity for a highly skilled Data...
-
Data Architect
hace 20 horas
Barcelona, Barcelona, España Data Bene A tiempo completo**Company Overview:**At Data Bene, we are a leading provider of innovative data solutions. Our team of experts is dedicated to helping our clients unlock the full potential of their data.**Job Description:**We are seeking an experienced Data Engineer to join our team. As a Data Engineer, you will play a key role in designing and developing our data...
-
Data Engineering Leader
hace 3 semanas
Barcelona, Barcelona, España Data Bene A tiempo completoAbout Data BeneAt Data Bene, we are seeking a skilled Data Engineer Leader to join our team. This is an exciting opportunity for an experienced professional to lead the design and development of automated data pipelines, implement best practices for data analytics, and oversee data model solutions.About the RoleWe estimate this position comes with a salary...
-
Data Engineering Leader
hace 4 semanas
Barcelona, Barcelona, España Ecf Data, Llc A tiempo completoEcf Data, LLC is seeking a highly skilled Data Engineer to join our team. The ideal candidate will have exceptional attention to detail and advanced computational skills, with the ability to rapidly develop and act upon in-depth knowledge of our business, products, and processes.The estimated salary for this position is $120,000 - $180,000 per year,...
-
Advanced Data Analytics Specialist
hace 4 semanas
Barcelona, Barcelona, España Data Science Festival A tiempo completoAbout the RoleA senior data analytics professional to lead advanced data science solutions in a FinTech organization. You will join a collaborative team of experts to build cutting-edge models using financial scorecards and leverage NLP and Machine Learning for future projects.Key Responsibilities- Collaborate with cross-functional teams to design and...
-
Data Engineer Lead
hace 3 semanas
Barcelona, Barcelona, España Roadsurfer GmbH A tiempo completoJob DescriptionWe are seeking an experienced Senior Data Engineer to lead our data engineering efforts and develop scalable data infrastructure on Google Cloud BigQuery.The ideal candidate will have a strong focus on building and maintaining data pipelines, as well as extensive experience with cloud-based data warehousing solutions. Additionally, the...
-
Global Cybersecurity Engineer
hace 3 semanas
Barcelona, Barcelona, España Novartis Farmacéutica A tiempo completoNovartis is seeking an experienced Global Cybersecurity Engineer to join our CSOC team in Prague, Czech Republic and Barcelona, Spain. The ideal candidate will have a strong background in data pipeline engineering and experience with SIEM platforms such as Sentinel and Splunk.The successful candidate will design, develop, implement, and manage dataflow...
-
Data Engineer with Scalable Data Pipelines
hace 4 semanas
Barcelona, Barcelona, España Team A tiempo completoJob Description:As a Data Engineer at Team, you will play a key role in developing and maintaining our central data warehouse. This involves designing, developing, and maintaining scalable data pipelines to ingest, process, and transform large volumes of structured and unstructured data from various sources. About the Company:Team is an ecosystem of 60+...
-
Senior Data Platform Engineer
hace 6 horas
Barcelona, Barcelona, España MAM Gruppe A tiempo completoData Platform Engineer Job DescriptionWe are seeking an experienced Senior Data Platform Engineer to join our team at MAM Gruppe. As a Senior Data Platform Engineer, you will be responsible for designing and delivering the core infrastructure for our transformative platform. Your key responsibilities will include designing and building a scalable,...
-
Data Architect
hace 2 semanas
Barcelona, Barcelona, España Data Bene A tiempo completoJob OverviewData Bene is seeking a highly skilled Data Architect to join our team. As a key member of our data engineering group, you will be responsible for designing and developing large-scale data pipelines and architectures.
-
Tech Leader for Scalable Data Pipelines
hace 2 semanas
Barcelona, Barcelona, España Splio A tiempo completoOverviewSplio is a leading SaaS marketing platform that integrates CDP and Marketing Automation, along with essential CRM features. With over 200 employees across Europe and MEA, we offer a unique opportunity to grow your career in a dynamic environment.Job SummaryWe are seeking an experienced Engineering Manager to lead our Data Processing & Metrics team....
-
Data Engineering Lead for Scalable Data Pipelines
hace 2 semanas
Barcelona, Barcelona, España Stayforlong A tiempo completoCompany OverviewStayforlong is a travel company that values prolonged stays and empowering customers to break free from industry constraints. Founded in Barcelona in 2015, we strive to offer a fresh perspective and flexibility to our customers, hoteliers, and partners.About the TeamWe are a dynamic and collaborative team of 80 people who believe in equal...
-
Senior Data Pipeline Specialist
hace 4 semanas
Barcelona, Barcelona, España Quantion A tiempo completoCompany OverviewQuantion is a Business Digital Transformation services company founded in 2015. With over 120 professionals in application development, UX/UI, and digital business transformation, we create innovative solutions focused on business results.We combine our cutting-edge technology teams with the innovation ecosystem to deliver the best solutions...
-
Data Infrastructure Engineer for Outdoor Travel
hace 20 horas
Barcelona, Barcelona, España roadsurfer A tiempo completoAbout #RoadsurferWe are an open, fast-growing team with ambitious goals and a great team spirit. We combine a brutal hands-on mentality with fun at work, shaping the future of outdoor travel and building an ecosystem for sustainable outdoor travel. Our products include rent, abo, sales, and roadsurfer spots – a platform where you can discover and book...