Data Engineer

hace 3 semanas

Madrid, España Nielseniq A tiempo completo

Company Description NIQ is the world's leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach.
Founded in Barcelona in 2001, Netquest is the data collection provider of choice for the Market Research Industry. A tech-driven company built on a robust and engaged panel and a strict quality standard (ISO 20252). We make possible a truly 360 degrees view of today's consumers collecting behavioral and declarative data from a single source, our panelists, in 23 countries across the globe. Leveraging our data, savvy researchers better define winning strategies based on an in-deep understanding of consumers' preferences and behaviors.
Job Description As a Data team, we have to cover the three main specialties in the data field: Data Science, Data Analytics, and Data Engineering. Today we have covered all the current needs in each field, but we are looking for a boost in the Data Engineering part, looking to the future, by adding a person who provides us experience and knowledge about doing things in the right direction.
Technologies and standards
Proficiency in Python and SQL
Awareness of scheduling tools, like Apache Airflow
Interest in Big Data solutions, like Apache Spark
In-depth understanding of Data Engineering techniques
Ability to maintain and extend processes and functionalities
Deep understanding of application packaging and delivery mechanisms, including CD/CI best practices and security concerns
The ability to integrate partial solutions and R&D results into production-ready data pipelines
The ability to build and operate infrastructure (e.g., for testing purposes)
The ability to support operational questions for environments in production
Understanding of cloud infrastructure and services available for setting up and maintaining data pipelines (e.g., AWS)
Ability to advise on data transformation workflow designs and optimizations with the dimensions of cost, performance, and delivery mechanisms (streams/increments/etc.)
Qualifications The ability to design and implement an entire data pipeline from scratch
The ability to decide which problems to solve with scale-up and which ones to tackle with scale-out approaches and how to combine them in data pipelines
Knowledge about Data Architecture
Awareness of Data Governance
An economic view on questions of operability of crafted data pipelines
Maintenance of data integrity in cases of reprocessing
Understanding of whether or how (internal or external) customer data deliveries are affected by changes to the software
Awareness of data design patterns in the organization and best practices in general
Deep understanding of data modeling, data schemas, and evolution thereof
Awareness of best practices of data transformation design patterns
An advanced focus on data integrity when crafting data pipelines, by building in means to monitor data health and state of intermediate data and alerting mechanisms
Designing Quality Control/Validation processes / Quality Gates
Additional Information The accountabilities of a senior data engineer include the accountabilities of a data engineer, but increased norms apply, meaning a senior data engineer is expected to be able to accomplish their tasks in less time, to a higher standard (total understanding and excellent adherence to applicable standards and guidelines) and be able to solve more complex problems.
The senior data engineer is expected to look beyond their primary team scope and strive for harmonization and improvement of solutions across the CSG or even beyond.
The senior data engineer is also accountable to pro-actively pass on their knowledge to other engineers when the opportunity arises during the course of their work:
During pair programming/pair work
When sought for advice
During code reviews
By participating in Communities of Practice
The senior data engineer is accountable for bringing together technical assets from different disciplines within their cross-functional team and for fostering a common solution approach between team members with different technical backgrounds.
Our Benefits
Flexible working environment
Volunteer time off
LinkedIn Learning
Employee-Assistance-Program (EAP)

#J-18808-Ljbffr

  • Data Engineer

    hace 3 meses

    Madrid, España Page Personnel España A tiempo completo

    Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIA PYTHON, PYSPARK, CLOUD INGLÉS ALTO INGENIERÍA INFORMÁTICA/TELECOMUNICACIONES/MATEMÁTICAS CONTRATO INDEFINIDO|CLIENTE FINAL Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIA PYTHON, PYSPARK, CLOUD INGLÉS ALTO INGENIERÍA...

  • Data Engineer

    hace 2 meses

    Madrid, España Walters People A tiempo completo

    Desde Walters People, buscamos Data Engineer, para potente empresa especializada en proyectos de Data & Analytics.Buscamos un perfil con:- Dos años de experiência como Data Engineer.- Experiência trabajando con Python, Scala y Spark.- Nível de inglés medio alto.- Valorable experiência en entornos Cloud.Contrato directo con cliente de forma indefinida,...

  • Data Engineer Junior

    hace 3 meses

    Madrid, España Page Personnel España A tiempo completo

    Al menos dos años de experiência como Data Engineer - Experiência con Python - Experiência con ETLs - Experiência con CLOUD (valorable GCP) Contrato indefinido|Trayectoria profesional - Al menos dos años de experiência como Data Engineer - Experiência con Python - Experiência con ETLs - Experiência con CLOUD (valorable GCP) Cliente final líder...

  • Data Engineer

    hace 3 meses

    Madrid, España sg tech A tiempo completo

    Descripción **Oferta de Trabajo: Data Engineer en sg tech**: ¡Hola! Estamos buscando un Data Engineer para unirse a nuestro equipo en sg tech. Si eres apasionado por la tecnología y tienes experiência en Azure, Azure Databricks, Spark, Scala, Azure Data Factory y Delta Lake, ¡sigue leyendo! **Posición: Data Engineer**: - ** Empresa**: sg tech - **...

  • Data Engineer

    hace 2 meses

    Madrid, España Sg Tech A tiempo completo

    Descripción**Oferta de Trabajo: Data Engineer en sg tech**:¡Hola! Estamos buscando un Data Engineer para unirse a nuestro equipo en sg tech. Si eres apasionado por la tecnología y tienes experiência en Azure, Azure Databricks, Spark, Scala, Azure Data Factory y Delta Lake, ¡sigue leyendo!**Posición: Data Engineer**:- ** Empresa**: sg tech- **...

  • Data Engineer

    hace 2 semanas

    Madrid, España Ecf Data, Llc A tiempo completo

    .Our MissionDcycle's mission is to give companies control over sustainability. Sustainability is a very complex language at the methodological level, data engineering, and software development. Yes, sustainability is more about data engineering than saving penguins. However, corporate sustainability teams lack these capabilities. They are unable to meet the...

  • Data Engineer – Data Lakehouse

    hace 2 semanas

    Madrid, España Vorwerk It Services Iberica S.L. A tiempo completo

    Data Engineer – Data Lakehouse at Vorwerk IT Services Iberica S.L.| softgarden View job here Data Engineer – Data Lakehouse Full Time Hybrid Calle de María de Molina, 54, 28006 Madrid, España With Professional Experience 8/27/24 Data Engineer – Data Lakehouse The "Data Engineer – Data Lakehouse" is responsible for the implementation of the...

  • Data Engineer

    hace 1 semana

    Madrid, España Ecf Data, Llc A tiempo completo

    Our MissionDcycle's mission is to give companies control over sustainability. Sustainability is a very complex language at the methodological level, data engineering, and software development. Yes, sustainability is more about data engineering than saving penguins. However, corporate sustainability teams lack these capabilities. They are unable to meet the...

  • Data Engineer – Data Lakehouse

    hace 2 semanas

    Madrid, España Vorwerk IT Services Iberica S.L. A tiempo completo

    Data Engineer – Data Lakehouse at Vorwerk IT Services Iberica S.L. | softgarden View job here Data Engineer – Data Lakehouse Full Time ...

  • Data Engineer

    hace 1 mes

    Madrid, España Ing A tiempo completo

    .At ING we are looking for Data Engineer Your role and work environment: We are looking for a talented and enthusiastic Data Engineer to join our Data Strategy Team of Data Management. The Data Management Tribe is focused on being Data Best-in-class, by ensuring the right data is in the right place at the right time for the right people to ignite the Data...

  • Data Management Engineer

    hace 2 semanas

    madrid, España JR Spain Teletrabajo Freelance A tiempo completo

    Desde Walters People, buscamos perfil de Data Management Engineer para empresa especializada en datos y puntera a nível internacional en el sector, centrada totalmente en proyectos de Data & Analytics. Se busca un perfil con unos criterios claves: - Background de ingeniería informática y/o telecomunicaciones o similares. - Experiência como Data...

  • Data Management Engineer

    hace 3 meses

    Madrid, España Walters People A tiempo completo

    Desde Walters People, buscamos perfil de Data Management Engineer para empresa especializada en datos y puntera a nível internacional en el sector, centrada totalmente en proyectos de Data & Analytics. Se busca un perfil con unos criterios claves: - Background de ingeniería informática y/o telecomunicaciones o similares. - Experiência como Data...

  • Data Management Engineer

    hace 3 meses

    Madrid, España Walters People A tiempo completo

    Desde Walters People, buscamos perfil de Data Management Engineer para empresa especializada en datos y puntera a nível internacional en el sector, centrada totalmente en proyectos de Data & Analytics.Se busca un perfil con unos criterios claves:- Background de ingeniería informática y/o telecomunicaciones o similares.- Experiência como Data Engineer de...

  • Data Engineer

    hace 3 meses

    Madrid, España Incubeta A tiempo completo

    **About us and our team**: Are you interested in working at one of only 4 global Google GMP sales partners? Do you want to join a rapidly growing team, in an international environment where you will find a lot of opportunities to develop yourself and collaborate with colleagues from different Countries all over the world? you are in the right...

  • Data Engineer

    hace 3 semanas

    Madrid, España Ing A tiempo completo

    .At ING we are looking for Data EngineerYour role and work environment:We are looking for a talented and enthusiastic Data Engineer to join our Data Strategy Team of Data Management.The Data Management Tribe is focused on being Data Best-in-class, by ensuring the right data is in the right place at the right time for the right people to ignite the Data...

  • Data Engineer

    hace 4 días

    Madrid, España Ing A tiempo completo

    .At ING we are looking for Data EngineerYour role and work environment:We are looking for a talented and enthusiastic Data Engineer to join our Data Strategy Team of Data Management.The Data Management Tribe is focused on being Data Best-in-class, by ensuring the right data is in the right place at the right time for the right people to ignite the Data...

  • Data Engineer

    hace 1 semana

    Madrid, España Glintt A tiempo completo

    Somos **Glintt Global**, una empresa tecnológica portuguesa líder, con más de 30 años de experiência. Centrada en aportar innovación en una sociedad en constante cambio, conecta el mundo de la salud a través de Glintt Life, líder ibérico en Healthtech, y apoya a las organizaciones en su viaje de transformación digital a través de Glintt Next, una...

  • Data Engineer Azure

    hace 1 mes

    Madrid, España Grupo Ns A tiempo completo

    Data Engineer Azure :Madrid - Publicada el 17 de mayo de 2024DescripciónDesde Grupo NS precisamos incorporar un Data Engineer con experiência en Azure.Skills :AzureDatatafactoryAzure DatalakeDatabricksPysparkPythonEl objetivo es analizar y desarrollar los procesos de ingesta, procesamiento y transformación de la información procedente de distintas...

  • Data Engineer

    hace 1 mes

    Madrid, España Levy Associates Ltd A tiempo completo

    A great client of mine who are a global investment firm are looking for a Data Engineer to join them on a 6-12 month Autonomo contract (the full project is looking around 2-3 years) and wanted to see if you are potentially on the market. The role will be in the office between 3 days a week in Madrid.Responsibilities:As a Data Engineer you will be developing...

  • Data Engineer

    hace 1 mes

    Madrid, España Tecdata Engineering A tiempo completo

    En Tecdata Engineering estamos en busca de un Data Engineer con al menos 2 años de experiencia en:Experiencia en SparkExperiencia en Scala