Data Engineer

hace 3 semanas

Madrid, España Dcycle A tiempo completo

Shape the next generation of sustainability at Dcycle. We are hiring a Data Engineer to help us reinvent sustainability.

Dcycle is a start-up willing to reinvent the whole sustainability industry in order to make it accessible to every SME through software. You will be working in a young and highly motivated environment.

Your new role as a Data Engineer - challenging and future-oriented

**Main responsibilities**

**You will (within the Platform and Machine Learning group)**:

- Design and develop end-to-end data solutions and modern data architectures for Dcycle products and teams (streaming ingestion, data lake, data warehouse...).
- Evolve and maintain Lykeion, a Machine Learning platform developed along with the Data Science team, to take care of the whole lifecycle of models and features. It includes a feature store, which allows other groups inside Dcycle to make better decisions based on data and a prediction platform to serve ML models.
- Design and maintain complex APIs exposing data at scale, that helps other teams to make better decisions.
- Provide the company with data discoverability and governance.
- Collaborate with other technical teams to define, execute and release new services and features.
- Manage and evolve our infrastructure. Continuously identify, evaluate, and implement new tools and approaches to maximize development speed and cost efficiency. Extract data from internal and external sources to empower our Analytics team.

**You will (within Analytics Engineering group)**:

- Maintain & evolve our data warehouse, making sure the data is easily accessible, reliable & accurate.
- Coordinate with other data stakeholders to ensure overall health and performance of the data warehouse environment. Design, develop, test, monitor, manage, and validate data warehouse activity. Including defining standards for the data warehouse as well as troubleshooting ETL processes and resolving issues effectively.

**Requirements for this position**

We are looking for experienced data engineers with excellent know-how in large-scale distributed systems:

- 3+ years of tenure in coding and delivering complex data engineering projects.
- Fluency in different programming languages (we work with **Python,** **Scala,** and Go; you don’t need to master all three of them).
- Deep understanding of:

- Message delivery systems and streaming processing (Kafka, RabbitMQ, Akka streams, Apache Beam )
- Data processing technology stacks and distributed processing (Hadoop, Spark, Apache Beam, Apache Flink...)
- Storage technologies (file-based, relational, columnar, document-based, key-value...)
- Orchestration tools such as Airflow, Luigi, or Dagster.
- Cloud infrastructures (**GCP**, AWS, Azure)
- Automation/IaC tools (Terraform, Puppet, Ansible )
- MLOps
- **Docker and Kubernetes**

**What we’re looking for (within Analytics Engineering group)**:

- Great alignment with our principals, we take this very seriously.
- You continuously find ways to derive more value in our raw data and lower the amount of effort our end users spend on getting answers.
- You can take a complex concept and make it sound simple. You're accomplished at orienting business users within the data domain, understanding their needs, and translating them into technical requirements to ultimately design effective data solutions.
- You have experience integrating data from multiple sources including DBs, product tracking, and APIs. You get excited by seeing your jobs run like clockwork.
- Proven track record in Data Modeling.
- At least 3 years tenure in coding and delivering complex data projects.
- At least 3 years of work experience in python.
- You have high-level SQL skills, which allows you to implement, understand, and improve complex queries.
- You have proper DBA skills, with which you should ensure high standards in DWH data accessibility, integrity, security & performance monitoring.

  • Data Engineer

    hace 4 semanas

    Madrid, España Page Personnel España A tiempo completo

    3 años de experiência como Data Engineer. Valorable CI/CD y certificación en GCP. Full remote|Proyección profesional 3 años de experiência como Data Engineer. Valorable CI/CD y certificación en GCP. Consultora con sede en Madrid dedicada al desarrollo de productos tecnológicos Oportunidades de carrera y desarrollo profesional. 3 años de...

  • Data Engineer

    hace 4 semanas

    Madrid, España Page Personnel España A tiempo completo

    Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIA PYTHON, PYSPARK, CLOUD INGLÉS ALTO INGENIERÍA INFORMÁTICA/TELECOMUNICACIONES/MATEMÁTICAS CONTRATO INDEFINIDO|CLIENTE FINAL Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIA PYTHON, PYSPARK, CLOUD INGLÉS ALTO INGENIERÍA...

  • Data Engineer

    hace 4 semanas

    Madrid, España Walters People A tiempo completo

    Desde Walters People, buscamos Data Engineer, para potente empresa especializada en proyectos de Data & Analytics. Buscamos un perfil con: - Dos años de experiência como Data Engineer. - Experiência trabajando con Python, Scala y Spark. - Nível de inglés medio alto. - Valorable experiência en entornos Cloud. Contrato directo con cliente de forma...

  • Data Engineer Junior

    hace 7 días

    Madrid, España Page Personnel España A tiempo completo

    Al menos dos años de experiência como Data Engineer - Experiência con Python - Experiência con ETLs - Experiência con CLOUD (valorable GCP) Contrato indefinido|Trayectoria profesional - Al menos dos años de experiência como Data Engineer - Experiência con Python - Experiência con ETLs - Experiência con CLOUD (valorable GCP) Cliente final líder...

  • Data Science Engineer

    hace 4 semanas

    Madrid, España TEC Partners A tiempo completo

    Job Type: Permanent Sector: Technology Seniority: Experienced Essential skils: Data Location: Madrid Region: Madrid Region Salary: Negotiable Data Science Engineer - Permanent Role - Minimum 2 years - Madrid Based TEC Partners is looking for a Data Science Engineer to join my clients Data team based in Madrid. You will play a key part in productising...

  • Data Engineer

    hace 2 semanas

    Madrid, España Tecdata Engineering A tiempo completo

    En Tecdata Engineering estamos en busca de un Data Engineer con inglés avanzadoPerfil data, con conocimiento de Python y buen nivel de inglés (lo necesitará, ya que es el proyecto e USA)Trabajará con snowflake, si lo sabe genial.Con 1 año de experiencia es suficiente

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Walters People A tiempo completo

    Desde Walters People estamos buscando un perfil de Data Engineer especializado en Power BI para incorporarse en plantilla de importante multinacional del sector de Data & Analytics con sede en Madrid.Te incorporarás en el equipo de Data de la compañía y participarás en los proyectos a nivel global y punteros tecnológicamente.Buscamos un perfil de Data...

  • Data Management Engineer

    hace 4 semanas

    Madrid, España Walters People A tiempo completo

    Desde Walters People, buscamos perfil de Data Management Engineer para empresa especializada en datos y puntera a nível internacional en el sector, centrada totalmente en proyectos de Data & Analytics. Se busca un perfil con unos criterios claves: - Background de ingeniería informática y/o telecomunicaciones o similares. - Experiência como Data...

  • Data Engineer Azure

    hace 6 días

    Madrid, España Grupo NS A tiempo completo

    **Volver a la página principal** **Data Engineer Azure** Madrid - Publicada el 12 de mayo de 2023 Descripción Desde Grupo NS precisamos incorporar un Data Engineer con experiência en Azure. **Skills**: - Azure - Datatafactory - Azure Datalake - Databricks - Synapse con el objetivo de analizar y desarrollar los procesos de ingesta, procesamiento y...

  • Data Engineer

    hace 3 semanas

    Madrid, España Page Personnel A tiempo completo

    CONTRATO INDEFINIDO|CLIENTE FINALCLIENTE FINAL RETADOR A NIVEL TÉCNICOBuscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIAPYTHON, PYSPARK, CLOUDINGLÉS ALTOINGENIERÍA INFORMÁTICA/TELECOMUNICACIONES/MATEMÁTICASBuscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIAPYTHON, PYSPARK, CLOUDINGLÉS ALTOINGENIERÍA...

  • Data Engineer

    hace 6 días

    Madrid, España Alter Solutions A tiempo completo

    **¿Qué buscamos?** Un perfil de **Data Engineer **con experiência de al menos 4 años utilizando alguna de las siguientes tecnologías: - Dominio de Python - Spark. - AWS Cloud. - Azure Data Lake, Data Factory y Databricks. - CI&CD - Git. - Nível de ingles: C1 **Additional Information**: **¿Qué podemos ofrecerte?** - ** **Modalidad de trabajo:...

  • Data Engineer

    hace 4 semanas

    Madrid, España WeDoData (Bristol) Ltd A tiempo completo

    **Data Engineer** A leading international client has several Data Engineer positions from Junior to Manager looking for someone to oversee data ingestion processes and deployment of ML/IA solutions for predictive analysis. You will collaborate with Data Scientist and Data Engineers to achieve project and client goals on a very dynamic environment. As a...

  • Data Engineer

    hace 4 semanas

    Madrid, España Walters People A tiempo completo

    Desde Walters People buscamos un Data Engineer para importante empresa de seguros perteneciente a una Multinacional líder Mundial en el Sector del Automóvil. La persona seleccionada debe contar con al menos 3 años de experiência realizando las funciones de Ingeniero de Datos con las siguinetes tecnologías: -Python -Pyspark -AWS -Power BI Además, es...

  • Data Engineer

    hace 6 días

    Madrid, España CGI A tiempo completo

    At CGI we are looking for a Data Engineer with Palantir.Requirements:- More than 2 years of experience in the architecture of data solutions developed in the cloud.- Palantir Certification- Python/PySpark for Data Engineer- Knowledge of data management fundamentals and data warehousing principles.- Demonstrated strength in data modelling, ETL and...

  • Data Engineer

    hace 4 semanas

    Madrid, España Aderen A tiempo completo

    Job Opening ID - 1715 - Project lenght in months - Largo Plazo - Languages - Español - Knowledge area - Skills - AWS - Rate - Eur - 220-250 - Job Description **SEEKING**: Data Engineer / Data Architect **PROFILE, TASKS & SKILLS**: We are looking for a Data Engineer/Data Architect with experience in Snowflake and AWS. Essential Skills: - At least 3 years...

  • Data Engineer Azure

    hace 3 semanas

    Madrid, España Grupo NS A tiempo completo

    **Descripción**: Desde Grupo NS precisamos incorporar un Data Engineer con experiência en Azure. **Skills**: - Azure - Datatafactory - Azure Datalake - Databricks - Synapse con el objetivo de analizar y desarrollar los procesos de ingesta, procesamiento y transformación de la información procedente de distintas fuentes para su posterior consumo por la...

  • Data Engineer

    hace 2 días

    Madrid, España TECDATA ENGINEERING A tiempo completo

    En TECDATA estamos buscando un Data Engineer con Experiencia de 3 años -en Spark ,Scala, SQL y Conocimientos en Cloudera, AWS  - ingles Avanzado -Remoto 100%

  • Data Engineer

    hace 3 semanas

    Madrid, España CGI A tiempo completo

    Position Description: At CGI we are looking for a Data Engineer with Palantir. Requirements: - More than 2 years of experience in the architecture of data solutions developed in the cloud. - Palantir Certification - Python/PySpark for Data Engineer - Knowledge of data management fundamentals and data warehousing principles. - Demonstrated strength...

  • Data Engineer

    hace 4 semanas

    Madrid, España NTT DATA A tiempo completo

    Si eres una persona analítica y tomas las decisiones basándote en los datos, déjanos darte uno que te permitirá soñar con grandes planes. En everis NTT Data, buscamos a gente como tú que nos ayude a liderar la nueva gestión integral del dato. Ha llegado el momento de escucharte, de crear nuevas posibilidades que te lleven hacia dónde quieres. Por...

  • Data Engineer Junior, Madrid

    hace 4 semanas

    Madrid, Madrid, España Page Personnel A tiempo completo

    Data Engineer Junior en Madrid.Perfil buscado (Hombre/Mujer) Al menos dos años de experiencia como Data Engineer Experiencia con Python Experiencia con ETLs Experiencia con CLOUD (valorable GCP) Contrato indefinido Trayectoria profesional Al menos dos años de experiencia como Data Engineer Experiencia con Python Experiencia con ETLs Experiencia con CLOUD...