Data Engineer

hace 4 días


Madrid Centro, Madrid, España John Snow Labs Inc A tiempo completo
Job Title: Data Engineer - Spark/Scala Expert

We are an international digital consultancy with a strong focus on innovation and employee development. Our team of 28,000 professionals is committed to delivering exceptional results and driving positive change in the world.

About the Role

We are seeking a highly skilled Data Engineer to join our dynamic team in Madrid. As a Data Engineer, you will play a crucial role in developing and managing our data pipelines, leveraging cutting-edge technologies to drive data-driven decisions.

Key Responsibilities
  • Design and develop streaming processes using Spark Streaming, Spark Structured Streaming, and Apache Kafka.
  • Manage legacy big data storage solutions (HDFS) and modern big data storage solutions (IBM Cloud Object Storage and parquet format).
  • Implement SQL/NoSQL database schemas, queries, and views (MongoDB, Oracle, Postgres).
  • Develop shell scripts and use Airflow as a data pipeline scheduling solution.
  • Familiarity with Dremio as a data virtualization tool and Dataiku as a data preparation tool is a plus.
Requirements
  • Proficiency in Spark on Scala for legacy data pipeline development.
  • Experience with Spark as a service on Scala for data pipeline development.
  • Strong background in designing and developing streaming processes.
  • High or native level of English is required.

  • Senior Data Engineer

    hace 6 días


    Madrid Centro, Madrid, España Clarity AI A tiempo completo

    Senior Data EngineerClarity AI is a global technology company dedicated to harnessing the power of artificial intelligence and machine learning to drive sustainable decision-making. Our team of experts is committed to delivering innovative solutions that empower investors, governments, companies, and consumers to make informed choices.We are seeking a highly...

  • Senior Data Engineer

    hace 7 días


    Madrid Centro, Madrid, España Clarity AI A tiempo completo

    Senior Data EngineerClarity AI is a global technology company dedicated to harnessing the power of artificial intelligence and machine learning to drive sustainable decision-making. Our team of experts is committed to delivering innovative solutions that empower investors, governments, companies, and consumers to make informed choices.We are seeking a highly...

  • Data Engineer

    hace 1 semana


    Madrid Centro, Madrid, España Ebury A tiempo completo

    About EburyEbury is a leading FinTech company, recognized as one of the top 15 European Fintechs to work for by AltFi. We offer a range of innovative products and services, including FX risk management, trade finance, currency accounts, international payments, and API integration.Position OverviewWe are seeking a highly skilled Data Engineer to join our Data...

  • Data Engineer

    hace 1 semana


    Madrid Centro, Madrid, España Ebury A tiempo completo

    About EburyEbury is a leading FinTech company, recognized as one of the top 15 European Fintechs to work for by AltFi. We offer a range of innovative products and services, including FX risk management, trade finance, currency accounts, international payments, and API integration.Position OverviewWe are seeking a highly skilled Data Engineer to join our Data...


  • Madrid Centro, Madrid, España Vorwerk IT Services Iberica A tiempo completo

    Data Engineer – Data LakehouseThe Data Engineer – Data Lakehouse is a key role within our team at Vorwerk IT Services Iberica, responsible for designing and implementing data architectures that support business intelligence, data exploration, and advanced analytics.Main Responsibilities:Design and implement data integration and transformation processes...


  • Madrid Centro, Madrid, España Vorwerk IT Services Iberica A tiempo completo

    Data Engineer – Data LakehouseThe Data Engineer – Data Lakehouse is a key role within our team at Vorwerk IT Services Iberica, responsible for designing and implementing data architectures that support business intelligence, data exploration, and advanced analytics.Main Responsibilities:Design and implement data integration and transformation processes...

  • Senior Data Engineer

    hace 1 semana


    Madrid Centro, Madrid, España Empresa reconocida A tiempo completo

    **About Us**Clarity AI is a leading global tech company dedicated to driving societal impact through innovative AI and machine learning solutions. We empower investors, governments, companies, and consumers with data-driven insights to make informed decisions. Our team of over 300 passionate individuals from diverse backgrounds has established Clarity AI as...

  • Senior Data Engineer

    hace 1 semana


    Madrid Centro, Madrid, España Empresa reconocida A tiempo completo

    **About Us**Clarity AI is a leading global tech company dedicated to driving societal impact through innovative AI and machine learning solutions. We empower investors, governments, companies, and consumers with data-driven insights to make informed decisions. Our team of over 300 passionate individuals from diverse backgrounds has established Clarity AI as...

  • Big Data Engineer

    hace 7 días


    Madrid Centro, Madrid, España Ust A tiempo completo

    {"h1": "Big Data Engineer Job Description", "p": "At UST, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Spark and Scala. Your expertise will help us deliver innovative data solutions to our...

  • Big Data Engineer

    hace 7 días


    Madrid Centro, Madrid, España Ust A tiempo completo

    {"h1": "Big Data Engineer Job Description", "p": "At UST, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and deploying large-scale data processing systems using Spark and Scala. Your expertise will help us deliver innovative data solutions to our...


  • Madrid Centro, Madrid, España ELCA Information Technology Ltd. A tiempo completo

    About the RoleWe are seeking a highly skilled Data Solutions Engineer to join our team at ELCA Information Technology Ltd. As a key member of our data engineering team, you will be responsible for designing and implementing data solutions for a diverse range of clients and industries.Key ResponsibilitiesCollaborate with business analysts and software...


  • Madrid Centro, Madrid, España ELCA Information Technology Ltd. A tiempo completo

    About the RoleWe are seeking a highly skilled Data Solutions Engineer to join our team at ELCA Information Technology Ltd. As a key member of our data engineering team, you will be responsible for designing and implementing data solutions for a diverse range of clients and industries.Key ResponsibilitiesCollaborate with business analysts and software...

  • Data Engineer

    hace 6 días


    Madrid Centro, Madrid, España PTC Group A tiempo completo

    Job Title: Data EngineerPTC Group is seeking a skilled Data Engineer to join our team in Madrid. As a Data Engineer, you will play a crucial role in designing and implementing data pipelines, APIs, and data processes within our data platform technical stack.Responsibilities:Develop and refine technical solutions to address business requirements, ensuring...

  • Data Engineer

    hace 7 días


    Madrid Centro, Madrid, España PTC Group A tiempo completo

    Job Title: Data EngineerPTC Group is seeking a skilled Data Engineer to join our team in Madrid. As a Data Engineer, you will play a crucial role in designing and implementing data pipelines, APIs, and data processes within our data platform technical stack.Responsibilities:Develop and refine technical solutions to address business requirements, ensuring...


  • Madrid Centro, Madrid, España Bdeo Spain A tiempo completo

    {"h1": "Transform the Insurance Industry with Data Analytics", "p": "At Bdeo Spain, we are revolutionizing the insurance industry with cutting-edge technology. As an Analytics Engineer, you will play a critical role in our data team, designing, developing, and maintaining data analytics' stack that empowers our teams to make data-driven decisions.Your main...


  • Madrid Centro, Madrid, España Bdeo Spain A tiempo completo

    {"h1": "Transform the Insurance Industry with Data Analytics", "p": "At Bdeo Spain, we are revolutionizing the insurance industry with cutting-edge technology. As an Analytics Engineer, you will play a critical role in our data team, designing, developing, and maintaining data analytics' stack that empowers our teams to make data-driven decisions.Your main...

  • Data Engineer

    hace 2 semanas


    Madrid Centro, Madrid, España Kingmakers A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at KingMakers. As a Data Engineer, you will play a critical role in designing and building high-value analytic datasets that can be used by a broad range of business stakeholders to drive business decision-making.Key ResponsibilitiesDesign and build high-value analytic datasets...

  • Data Engineer

    hace 2 semanas


    Madrid Centro, Madrid, España Kingmakers A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at KingMakers. As a Data Engineer, you will play a critical role in designing and building high-value analytic datasets that can be used by a broad range of business stakeholders to drive business decision-making.Key ResponsibilitiesDesign and build high-value analytic datasets...

  • Big Data Engineer

    hace 7 días


    Madrid Centro, Madrid, España Fujitsu A tiempo completo

    Cybersecurity Analytics Data EngineerFujitsu is seeking a highly skilled Data Engineer to join our team in Spain. As a Data Engineer, you will play a key role in designing and implementing data solutions that drive business value.About the Role:You will work with data loading processes, master data management, data migrations, and real-time processes.You...

  • Big Data Engineer

    hace 7 días


    Madrid Centro, Madrid, España Fujitsu A tiempo completo

    Cybersecurity Analytics Data EngineerFujitsu is seeking a highly skilled Data Engineer to join our team in Spain. As a Data Engineer, you will play a key role in designing and implementing data solutions that drive business value.About the Role:You will work with data loading processes, master data management, data migrations, and real-time processes.You...