Data Engineer

hace 2 semanas

Madrid, Madrid, España Talan A tiempo completo
Company Description


Talan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€.

We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities:

  • CONSULTING in management and innovation : supporting business, managerial, cultural, and technological transformations.
  • DATA & TECHNOLOGY to implement major transformation projects.
  • CLOUD & APPLICATION SERVICES to build or integrate software solutions.
  • SERVICE CENTERS of EXCELLENCE to support the latter through technology, innovation, agility, sustainability of skills and cost optimization.
Talan accelerates it's clients' transformation through innovation and technology.

By understanding their challenges, with our support, innovation, technology and data, we enable them to be more efficient and resilient.


We believe that only a human oriented-practice of technology will make the new digital age an era of progress for all.

Together let's commit

Job Description:


The data engineer is a key role in any of the different data squads in charge of development and maintenance of new big data data platforms and data products.

His/her main mission is to develop the different data pipelines which ingest, transform and prepare data from different sources into the different layers of our datahub platform and/or data products.

ROLES / RESPONSIBILITIES

  • Develop data pipelines with Spark and Scala to ingest and transform data from different sources (API, files, Kafka topics) into HDFS, IBM Cloud Storage, Parquet or SQL/NOSQL databases
  • Manage big data storage solutions in the platform (HDFS, IBM Cloud Storage, Parquet)
  • Implementation of schemas and queries in SQL/NOSQL databases like postgres, MongoDB or Oracle
  • Develop and configure scheduling of data pipelines with a combination of shell scripting and autosys, oozie or AirFlow
  • Configure Dremio Data Virtualization to interface with Parquet or as a way to expose the data in the different data products
  • Configure Dataiku pipelines as a data preparation tool for loading and transformation of data from our big data platform into specific datamarts for data or business products
  • Provide N3 level support to end users

Qualifications:

  • You have a higher degree in the field of business intelligence or data science or computer science with at least 5 years of experience in a similar position.
  • Your knowledge of the modern BI technology stack is your strength, ideally in the Talend / Snowflake / Tableau environment.
  • You have a confirmed experience in leading workshop with the business for the definition of KPI, as well as in the development of data pipeline with Talend, from the sources to the data warehouse, and then the development of dashboards in Tableau.
  • You are comfortable communicating with the professions and synthesizing the issues. You are structured in your approach while remaining result oriented.
  • Your collaborative spirit makes you a key partner and you are familiar with agile methodologies.
  • Experience in marketing data (Google Analytics, social media and custom solutions) is a plus.
  • You are fluent in English and ideally also in French.
Additional Information

IT TOOLS

  • Spark and Scala as legacy data pipeline development language
  • SparkaaS and Scala as data pipeline development platform
  • Management of legacy big data storage solutions (HDFS and Parquet)
  • Management of big data storage solutions (IBM Cloud Object Storage and Parquet)
  • Implementation of SQL/NO SQL database schemas and queries (MongoDB, Oracle, Postgres)
  • Ksh, Autosys and Oozie as legacy data pipeline scheduling solution
  • Ksh and Airflow as data pipelie scheduling solution
  • Dremio as data virtualization too.
  • Dataiku as data preparation toolMigration from SAS to Spark as a bonus.

BUSINESS SKILLS
Knowledge of banking industry and processes
Business / IT Relationship

BEHAVIOURAL SKILLS
Ability to understand, explain and support change
Ability to Deliver / Results Driven
Ability to collaborate / Teamwork
Ability to manage a project as a bonus

TRANSVERSAL SKILLS
Agile

LANGUAGES
English C1
French as a bonu

  • Data Engineer Con Conocimientos En Mongodb

    hace 2 semanas

    Madrid, Madrid, España Data Spree Gmbh A tiempo completo

    Data Engineer con conocimientos en MongoDB. Factech es una empresa multinacional especializada en proporcionar a las grandes compañías servicios de IT en las principales tecnologías, contamos con más de 2500 profesionales al servicio de nuestros principales clientes. Nuestras sedes se reparten en España, Colombia y México.Nos encontramos en constante...

  • Data Engineer Con Conocimientos En Sparkscala

    hace 2 semanas

    Madrid, Madrid, España Data Spree Gmbh A tiempo completo

    Data Engineer con conocimientos en SparkScala Factech es una empresa multinacional especializada en proporcionar a las grandes compañías servicios de IT en las principales tecnologías, contamos con más de 2500 profesionales al servicio de nuestros principales clientes. Nuestras sedes se reparten en España, Colombia y México.Nos encontramos en constante...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Page Personnel España A tiempo completo

    3 años de experiência como Data Engineer. Valorable CI/CD y certificación en GCP.Full remote|Proyección profesional3 años de experiência como Data Engineer. Valorable CI/CD y certificación en GCP.Consultora con sede en Madrid dedicada al desarrollo de productos tecnológicosOportunidades de carrera y desarrollo profesional.3 años de experiência como...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Walters People A tiempo completo

    Desde Walters People, buscamos Data Engineer, para potente empresa especializada en proyectos de Data & Analytics.Buscamos un perfil con: Dos años de experiência como Data Engineer. Experiência trabajando con Python, Scala y Spark. Nível de inglés medio alto. Valorable experiência en entornos Cloud.Contrato directo con cliente de forma indefinida,...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Cgi A tiempo completo

    Position Description: At CGI we are looking for a Data Engineer with PalantirRequirements: More than 2 years of experience in the architecture of data solutions developed in the cloud. Palantir Certification Python/PySpark for Data Engineer Knowledge of data management fundamentals and data warehousing principles. Demonstrated strength in data modelling, ETL...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España CGI A tiempo completo

    Position Description: At CGI we are looking for a Data Engineer with Palantir. Requirements: - More than 2 years of experience in the architecture of data solutions developed in the cloud. - Palantir Certification - Python/PySpark for Data Engineer - Knowledge of data management fundamentals and data warehousing principles. - Demonstrated strength in...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Page Personnel España A tiempo completo

    Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIAPYTHON, PYSPARK, CLOUDINGLÉS ALTOINGENIERÍA INFORMÁTICA/TELECOMUNICACIONES/MATEMÁTICASCONTRATO INDEFINIDO|CLIENTE FINALBuscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIAPYTHON, PYSPARK, CLOUDINGLÉS ALTOINGENIERÍA INFORMÁTICA/TELECOMUNICACIONES/MATEMÁTICASCLIENTE...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Walters People A tiempo completo

    Desde Walters People estamos buscando un perfil de Data Engineer especializado en Power BI para incorporarse en plantilla de importante multinacional del sector de Data & Analytics con sede en Madrid.Te incorporarás en el equipo de Data de la compañía y participarás en los proyectos a nível global y punteros tecnológicamente.Buscamos un perfil de Data...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Grupo Digital A tiempo completo

    Data Engineer / Data Integration en Madrid.Desde Grupo Digital buscamos para importante cliente de ambito internacionalDATA ENGINEER // DATA INTEGRATION More than 6 years experiencie in DWH ETL and data governance area.Analysis design and implementation of data provisioning and lineage solutions. Excellent knowledge of ETL and BA tools in Special Information...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Cgi A tiempo completo

    At CGI we are looking for a Data Engineer with PalantirRequirements:More than 2 years of experience in the architecture of data solutions developed in the cloud.Palantir CertificationPython/PySpark for Data EngineerKnowledge of data management fundamentals and data warehousing principles.Demonstrated strength in data modelling, ETL and Storage/Data Lake...

  • Data Engineer Junior

    hace 2 semanas

    Madrid, Madrid, España Page Personnel España A tiempo completo

    Al menos dos años de experiência como Data Engineer Experiência con Python Experiência con ETLs Experiência con CLOUD (valorable GCP)Contrato indefinido|Trayectoria profesional Al menos dos años de experiência como Data Engineer Experiência con Python Experiência con ETLs Experiência con CLOUD (valorable GCP)Cliente final líder en el sector...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Jr Spain A tiempo completo

    col-wideJob Description:Desde Walters People, buscamos Data Engineer, para incorporar en la plantilla de un cliente final. Empresa multinacional con su Hub Tecnológico Europeo situado en Madrid.Buscamos un perfil con: Al menos dos años de experiência a nível laboral Data Engineer. Experiência trabajando con tecnologías como Python o PySpark. Valorable...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Clarity Ai A tiempo completo

    We are looking for an organized Data Engineer to join our amazing team at Clarity AI in Madrid.Growing your career as a Full Time Data Engineer is an awesome opportunity to develop key skills.If you are strong in planning, communication and have the right drive for the job, then apply for the position of Data Engineer at Clarity AI today Madrid, Community of...

  • Data Engineer

    hace 4 semanas

    Madrid, Madrid, España Walters People A tiempo completo

    Desde Walters People estamos buscando un perfil de Data Engineer especializado en Power BI para incorporarse en plantilla de importante multinacional del sector de Data & Analytics con sede en Madrid.Te incorporarás en el equipo de Data de la compañía y participarás en los proyectos a nivel global y punteros tecnológicamente.Buscamos un perfil de Data...

  • Data Engineer

    hace 2 meses

    Madrid, Madrid, España Walters People A tiempo completo

    Desde Walters People estamos buscando un perfil de Data Engineer especializado en Power BI para incorporarse en plantilla de importante multinacional del sector de Data & Analytics con sede en Madrid.Te incorporarás en el equipo de Data de la compañía y participarás en los proyectos a nivel global y punteros tecnológicamente.Buscamos un perfil de Data...

  • Data Engineer Junior

    hace 2 semanas

    Madrid, Madrid, España Krell Consulting & Training A tiempo completo

    Data Engineer Junior (Snowflake) en 100% En remoto.Nos encontramos en la búsqueda de un/a Data Engineer Junior para trabajar con importante cliente en contratación inicial con KRELL.DESCRIPCION Data Engineer Junior Perfil Data Engineer con experiencia entre 1-2 años en entornos Cloud (Snowflake AWS) Experiencia mínima de 6 meses trabajando con...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Itjobs A tiempo completo

    At CGI we are looking for a Data Engineer with PalantirRequirements:More than 2 years of experience in the architecture of data solutions developed in the cloud.Palantir CertificationPython/PySpark for Data EngineerKnowledge of data management fundamentals and data warehousing principles.Demonstrated strength in data modelling, ETL and Storage/Data Lake...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Grupo Ns A tiempo completo

    Data Engineer:Madrid Publicada el 9 de febrero de 2024DescripciónEn Grupo NS estamos seleccionando un Data Engineer con experiência en: SnowFlake, Datawarehouse, SQL, NoSQL Diseño de soluciones y desarrollo de procesos de datos Conocimientos en Cloud y PythonGrupo NS, es una empresa donde se valora tanto el perfil profesional tecnológico de los...

  • Data Engineer, Madrid

    hace 2 semanas

    Madrid, Madrid, España Undisclosed A tiempo completo

    Data Engineer en Madrid. Perfil buscado (Hombre/Mujer) Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIA PYTHON PYSPARK CLOUD INGLÉS ALTO INGENIERÍA INFORMÁTICA/TELECOMUNICACIONES/MATEMÁTICAS CONTRATO INDEFINIDO CLIENTE FINAL Buscamos un perfil DATA ENGINEER CON AL MENOS 3 AÑOS DE EXPERIENCIA PYTHON PYSPARK CLOUD INGLÉS ALTO...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Sdi Digital Group A tiempo completo

    Position Description :At CGI we are looking for a Data Engineer with PalantirRequirements :More than 2 years of experience in the architecture of data solutions developed in the cloud.Palantir CertificationPython / PySpark for Data EngineerKnowledge of data management fundamentals and data warehousing principles.Demonstrated strength in data modelling, ETL...