Data Engineer/wrangler

hace 3 meses

Barcelona, España Barcelona Supercomputing Center - Centro Nacional de Supercomputación A tiempo completo

**Context And Mission
At the Data Analytics and Visualization Group of the BSC, we are looking for a software engineer to work with us to develop infrastructure and to manage the data ingestion and collection for our data pipelines, specially digital twins. The position involves developing and deploying data ingestion, cleaning, preparation, and storage pipelines, and make It available to machine learning and interface layers.

**Key Duties
- Develop the data processing layer of a platform for urban digital twins
- Implement usable tools to control and monitor all steps of the pipelines
- Document all the data preparation and processing steps to ensure traceability of the data Produce documentation of the code

**Requirements
EducationBachelor’s degree in Software Engineering or equivalent
- Essential Knowledge and Professional ExperienceExpert knowledge of Python and C++
- Master’s degree in Computer Science or equivalent. Alternatively, 1-year experience as a software engineer/developer
- Experience on virtualization, communication, and storage platforms
- Additional Knowledge and Professional ExperienceExperience working with Apache Kafka, Spark
- Experience with some orchestrating software
- Experience in workflow software
- Interest in science, research, and engineering a plus
- CompetencesSelf-organization and problem-solving
- Proactive, ability to take initiative and prioritize tasks
- Ability to work independently
- Good written and verbal communication skills

**Conditions
- The position will be located at BSC within the CASE Department
- We offer a full-time contract (37.5h/week), a good working environment, a highly stimulating environment with state-of-the-art infrastructure, flexible working hours, extensive training plan, restaurant tickets, private health insurance, support to the relocation procedures
- Duration: Open-ended contract due to technical and scientific activities linked to the project and budget duration
- Holidays: 23 paid vacation days plus 24th and 31st of December per our collective agreement
- Starting date: asap

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España ECF Data A tiempo completo

    About ECF DataECF Data is a forward-thinking organization that prioritizes innovation and sustainability in the fashion industry. We're committed to creating a responsible shopping experience and reducing overproduction in fashion.The RoleWe're seeking a highly skilled Data Engineer | Data Analyst to join our team. As a key member of our data team, you will...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España ECF Data A tiempo completo

    About ECF DataECF Data is a forward-thinking organization that prioritizes innovation and sustainability in the fashion industry. We're committed to creating a responsible shopping experience and reducing overproduction in fashion.The RoleWe're seeking a highly skilled Data Engineer | Data Analyst to join our team. As a key member of our data team, you will...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About Ecf Data, LlcEcf Data, Llc is a dynamic and innovative company that is committed to delivering exceptional data solutions. We are a team of passionate professionals who are dedicated to helping our clients achieve their goals through data-driven insights.The RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team. As a Data...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About Ecf Data, LlcEcf Data, Llc is a dynamic and innovative company that is committed to delivering exceptional data solutions. We are a team of passionate professionals who are dedicated to helping our clients achieve their goals through data-driven insights.The RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team. As a Data...

  • Data Engineer | Data Analyst

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It's demanding but extremely...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing and developing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google Cloud...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing, developing, and managing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing and developing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google Cloud...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing, developing, and managing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy!It's demanding but extremely...

  • Data Engineer

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .This is what you will do:The Data Engineer role is a key member of the Data Team, reporting to the Director of Data Engineering Services, and has close interaction with Functional Leads, Data Architects, Data Analysts and Data Scientists.In this role, the individual will be responsible for designing and overseeing the creation of automated data pipelines,...

  • Data Engineer | Data Analyst

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy!It's demanding but extremely...

  • Data Engineer | Data Analyst

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It's demanding but extremely...

  • Data Engineer | Data Analyst

    hace 2 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand: it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion. Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It's demanding but extremely...

  • Data Engineer

    hace 2 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    This is what you will do: The Data Engineer role is a key member of the Data Team, reporting to the Director of Data Engineering Services, and has close interaction with Functional Leads, Data Architects, Data Analysts and Data Scientists.In this role, the individual will be responsible for designing and overseeing the creation of automated data pipelines,...

  • Data Engineer

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    This is what you will do:The Data Engineer role is a key member of the Data Team, reporting to the Director of Data Engineering Services, and has close interaction with Functional Leads, Data Architects, Data Analysts and Data Scientists.In this role, the individual will be responsible for designing and overseeing the creation of automated data pipelines,...

  • Principal Data Engineer

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .Introduction to Role:Join us at AstraZeneca's Alexion as a Principal Data Engineer, a key member of the Data Team. This role offers the opportunity to design and oversee the creation of automated data pipelines, implement best practices for data analytics, supervise data model solutions, and offer strategic insights based on data queries. If you are...

  • Principal Data Engineer

    hace 4 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .Introduction to Role:Join us at AstraZeneca's Alexion as a Principal Data Engineer, a key member of the Data Team. This role offers the opportunity to design and oversee the creation of automated data pipelines, implement best practices for data analytics, supervise data model solutions, and offer strategic insights based on data queries. If you are...

  • Data Engineer

    hace 1 semana

    Barcelona, Barcelona, España Ambit A tiempo completo

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Ambit. As a Data Engineer, you will be responsible for designing, constructing, and maintaining highly scalable data management systems on AWS.Key Responsibilities:Design and implement data pipelines to support continuous data ingestion, processing, and analytics.Collaborate...

  • Data Engineer

    hace 1 semana

    Barcelona, Barcelona, España Ambit A tiempo completo

    Job Title: Data EngineerWe are seeking a skilled Data Engineer to join our team at Ambit. As a Data Engineer, you will be responsible for designing, constructing, and maintaining highly scalable data management systems on AWS.Key Responsibilities:Design and implement data pipelines to support continuous data ingestion, processing, and analytics.Collaborate...