Data Engineer
hace 2 días
We are seeking a talented Data Engineer to join our team in Madrid with a hybrid work model. As a Data Engineer, you will play a crucial role in developing and managing our data pipelines.
Key Responsibilities:- Design and develop data pipelines using Spark on Scala for legacy data pipeline development.
- Experience with Spark as a service on Scala for data pipeline development.
- Strong background in designing and developing streaming processes using Spark Streaming, Spark Structured Streaming, and Apache Kafka.
- Manage legacy big data storage solutions (HDFS) and experience with modern big data storage solutions (IBM Cloud Object Storage and parquet format).
- Implement SQL/NoSQL database schemas, queries, and views (MongoDB, Oracle, Postgres).
- Shell scripting skills and experience with Airflow as a data pipeline scheduling solution.
- Familiarity with Dremio as a data virtualization tool.
- Knowledge of Dataiku as a data preparation tool is a plus.
- High or native level of English is required.
We are an international, agile digital consultancy. In the post-digital transformation era, we strive to ensure that each of our 28,000 professionals can continuously renew themselves.
Each of them can design their professional journey according to their preferences, collaborate with their clients to practically build a more positive world, innovate in each of the 27 countries, and balance their professional career with their personal well-being.
We are proud to have been certified as a Top Employer Europe 2024.
-
Data Engineer AWS con ElasticSearch y Python
hace 17 horas
Madrid, Madrid, España Data Privacy A tiempo completoDescripción del PuestoEstamos buscando a un Data Engineer con experiencia en AWS y ElasticSearch para unirse a nuestro equipo de Data Privacy.Como Data Engineer, serás responsable de participar en el desarrollo de una herramienta de AML basada en inteligencia artificial, Big Data y Procesamiento en tiempo real.ResponsabilidadesAnálisis de requerimientos y...
-
Data Engineer AWS con ElasticSearch y Python
hace 20 horas
Madrid, Madrid, España Data Privacy A tiempo completoDescripción del PuestoEstamos buscando a un Data Engineer con experiencia en AWS y ElasticSearch para unirse a nuestro equipo de Data Privacy.Como Data Engineer, serás responsable de participar en el desarrollo de una herramienta de AML basada en inteligencia artificial, Big Data y Procesamiento en tiempo real.ResponsabilidadesAnálisis de requerimientos y...
-
Data Engineer AWS con Elasticsearch y Python
hace 2 días
Madrid, Madrid, España Data Privacy A tiempo completoDescripción del PuestoEstamos buscando un Data Engineer con experiencia en Elasticsearch y Python en AWS para unir nuestro equipo de Data Privacy.ResponsabilidadesParticipar en el desarrollo de una herramienta de AML basada en inteligencia artificial, Big Data y Procesamiento en tiempo real.Análisis de requerimientos y participación en el diseño de...
-
Data Engineer AWS con Elasticsearch y Python
hace 2 días
Madrid, Madrid, España Data Privacy A tiempo completoDescripción del PuestoEstamos buscando un Data Engineer con experiencia en Elasticsearch y Python en AWS para unir nuestro equipo de Data Privacy.ResponsabilidadesParticipar en el desarrollo de una herramienta de AML basada en inteligencia artificial, Big Data y Procesamiento en tiempo real.Análisis de requerimientos y participación en el diseño de...
-
Data Engineer
hace 2 días
Madrid, Madrid, España Sg Tech A tiempo completoOferta de Trabajo: Data Engineer en Sg TechEstamos buscando un Data Engineer apasionado por la tecnología y con experiencia en Azure, Azure Databricks, Spark, Scala, Azure Data Factory y Delta Lake.Posición: Data EngineerEmpresa: Sg TechExperiencia: 3 añosDescripción del TrabajoComo Data Engineer en Sg Tech, tendrás la responsabilidad de desarrollar,...
-
Data Engineer
hace 2 días
Madrid, Madrid, España Sg Tech A tiempo completoOferta de Trabajo: Data Engineer en Sg TechEstamos buscando un Data Engineer apasionado por la tecnología y con experiencia en Azure, Azure Databricks, Spark, Scala, Azure Data Factory y Delta Lake.Posición: Data EngineerEmpresa: Sg TechExperiencia: 3 añosDescripción del TrabajoComo Data Engineer en Sg Tech, tendrás la responsabilidad de desarrollar,...
-
Data Engineer
hace 2 días
Madrid, Madrid, España Inetum Spain A tiempo completoAbout the RoleWe are seeking a highly skilled Data Engineer to join our team in Inetum Spain. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key ResponsibilitiesDesign and implement data pipelines using DataStageDevelop and maintain data warehouses and data martsEnsure data...
-
Data Engineer
hace 2 días
Madrid, Madrid, España Inetum Spain A tiempo completoAbout the RoleWe are seeking a highly skilled Data Engineer to join our team in Inetum Spain. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key ResponsibilitiesDesign and implement data pipelines using DataStageDevelop and maintain data warehouses and data martsEnsure data...
-
Data Engineer
hace 3 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 3 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 3 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 3 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 2 días
Madrid, Madrid, España Engineeringuk A tiempo completoJob Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at Engineeringuk. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data warehouses and data lakes using Microsoft...
-
Data Engineer
hace 2 días
Madrid, Madrid, España Engineeringuk A tiempo completoJob Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at Engineeringuk. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and implement data warehouses and data lakes using Microsoft...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 4 semanas
Madrid, Madrid, España TEKsystems A tiempo completoAbout the Role:We are seeking a highly skilled Data Engineer to join our team at TEKsystems. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Python, SQL, and PySparkDevelop and maintain data warehouses using Azure Cloud (Data Factory,...
-
Data Engineer
hace 4 semanas
Madrid, Madrid, España TEKsystems A tiempo completoAbout the Role:We are seeking a highly skilled Data Engineer to join our team at TEKsystems. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Python, SQL, and PySparkDevelop and maintain data warehouses using Azure Cloud (Data Factory,...
-
Data Engineer
hace 3 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics,...
-
Data Engineer
hace 3 semanas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will play a crucial role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics,...