Senior Data Engineer

hace 3 semanas


Sin especificar, España Inetum A tiempo completo

Inetum is an agile IT services company that provides digital services and solutions, and a global group that helps companies and institutions to get the most out of digital flow.

In a context of perpetual movement, where needs and usages are constantly being reinvented, the Inetum group is committed to all these players to innovate, continue to adapt, and stay ahead.

With its multi-expert profile, Inetum offers its clients a unique combination of proximity, a breakdown by sector, and state of the art solutions.

We are looking for a DATA ENGINEER to run projects and maintenance activities in Madrid team.

ROLES / RESPONSIBILITIES:

  • Develop data pipelines with Spark and Scala to ingest and transform data from different sources (Kafka topics, APIs, files) into HDFS, IBM Cloud Storage, Parquet or SQL/NOSQL databases.
  • Manage big data storage solutions in the platform (HDFS, IBM Cloud Storage, Parquet).
  • Implementation of schemas and queries in SQL/NOSQL databases like postgres, MongoDB or Oracle.
  • Develop and configure scheduling of data pipelines with a combination of shell scripting and Autosys, Oozie or AirFlow.
  • Configure Dremio Data Virtualization to interface with Parquet or as a way to expose the data in the different data products.
  • Configure Dataiku pipelines as a data preparation tool for loading and transformation of data from our big data platform into specific datamarts for data or business products.
  • Provide N3 level support to end users

IT TOOLS:

  • Spark and Scala as legacy data pipeline development language.
  • SparkaaS and Scala as data pipeline development platform.
  • Experience in the design and development of streaming procesess using Spark Streaming, Spart Structure Streaming, and Apache Kafka.
  • Management of legacy big data storage solutions (HDFS and Parquet).
  • Management of big data storage solutions (IBM Cloud Object Storage and Parquet).
  • Implementation of SQL/NO SQL database schemas and queries (MongoDB, Oracle, Postgres).
  • Ksh, Autosys and Oozie as legacy data pipeline scheduling solution.
  • Ksh and Airflow as data pipelie scheduling solution.
  • Dremio as data virtualization tool.
  • Dataiku as data preparation tool.
  • Migration from SAS to Spark as a bonus

SKILLS:

  • Knowledge of banking industry and processes.
  • Business / IT Relationship

BEHAVIOURAL

SKILLS:

  • Ability to understand, explain and support change.
  • Ability to Deliver / Results Driven.
  • Ability to collaborate / Teamwork.
  • Ability to manage a project as a bonus.
  • Knowledge of Spark SQL and Spark MLib as bonus.
  • Experience with tools monitoring and management of logs (Prometheus, Grafana, ELK Stack, ...) as bonus.

TRANSVERSAL

SKILLS:

  • Agile

LANGUAGES:

  • English C1
  • French as a bonus Join us @Inetum. #Weareinetum


  • Sin especificar, España Sin especificar A tiempo completo

    DESCRIPTION Do you have a systems engineering background and strong knowledge in Data DevOps? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Data DevOps Engineer. Our teams work in highly agile working environments for Fortune clients, following XP...


  • Sin especificar, España Sin especificar A tiempo completo

    DESCRIPTION Do you have a sofware engineering background and strong knowledge in Big Data? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Big Data Engineer. Our teams work in highly agile working environments for Fortune clients, following XP practices and...


  • Sin especificar, España HAYS A tiempo completo

    Data engineer Senior en Navarra.Desde HAYS estamos colaborando con una empresa de sector industrial en pleno crecimiento y desarrollo ubicada en Navarra que se encuentra en búsqueda de un Data Engineer Senior para unirse a su equipo.¿Qué requisitos son necesarios? Perfil que venga del sector industrial. Experiencia gestionando proyectos.Formación ...

  • Data Engineer Senior/AWS

    hace 4 semanas


    Sin especificar, España Krell Consulting & Training A tiempo completo

    Data Engineer Senior/AWS (Inglés) en 100% En remoto.Krell-Consulting está en la búsqueda de un Ingeniero con experiencia en AWS para unirse a nuestro equipo. Si tienes al menos 3 años de experiencia trabajando con AWS y estás buscando un nuevo desafío esta podría ser la oportunidad perfecta para tiPERFIL Ingeniero Senior Datos/AWSSECTOR...

  • Senior DFT Engineer

    hace 2 semanas


    Sin especificar, España IC Resources A tiempo completo

    Senior DFT Engineer – Barcelona - Innovative RISC-V Developments!This is a fantastic opportunity for a Senior DFT Engineer to work on complex projects and RISC-V IP. This is a brand new role within a new ASIC Development team, meaning that you will be involved in defining DFT methodologies and architecture.The key skills needed for the Senior DFT Engineer...

  • Senior DFT Engineer

    hace 2 semanas


    Sin especificar, España IC Resources A tiempo completo

    Senior DFT Engineer – Barcelona Innovative RISC-V DevelopmentsThis is a fantastic opportunity for a Senior DFT Engineer to work on complex projects and RISC-V IP. This is a brand new role within a new ASIC Development team, meaning that you will be involved in defining DFT methodologies and architecture.The key skills needed for the Senior DFT Engineer...


  • Sin especificar, España Sin especificar A tiempo completo

    En PER SÉ Recursos humanos (www.perserrhh.com) estamos buscando Salesforce Data Cloud Engineer para incorporarse a nuestro cliente, compañía muy sensibilizada con la aplicación de soluciones orientadas a la analítica avanzada y a la inteligencia artificial. Serás responsable de colaborar en el desarrollo de la estrategia relacionada con toda la...

  • Data Engineer

    hace 5 días


    Sin especificar, España WeHunt España A tiempo completo

    Resumen del puestoData Engineer Empresa puntera en proyectos de Inteligencia Artificial y Big Data. Perfil buscado (H/M/D)Experiencia de al menos dos años en el desarrollo y despliegue de aplicaciones de procesamiento de datos en la nube con Azure.Conocimientos y experiencia en el ámbito de CI/CD y DevOpsExperiencia con Python y Java y/o Scala.Experiencia...

  • Lead Data Engineer

    hace 4 días


    Sin especificar, España Levy Search A tiempo completo

    My client in the financial services industry is looking for a Lead Data Engineer to join them on a permanent basis in Madrid. Responsibilities: Lead a team of Data Engineers and Data Architects in creating a robust cloud-based data processing framework.Ensure best practices in code versioning, technical documentation, and CI/CD.Maintain high standards of...

  • Lead Data Engineer

    hace 4 días


    Sin especificar, España Levy Search A tiempo completo

    My client in the financial services industry is looking for a Lead Data Engineer to join them on a permanent basis in MadridResponsibilities:Lead a team of Data Engineers and Data Architects in creating a robust cloud-based data processing framework.Ensure best practices in code versioning, technical documentation, and CI/CD.Maintain high standards of...


  • Sin especificar, España Sin especificar A tiempo completo

    Senior Software Engineer - Full Stack Pharmaspectra We are looking for a highly motivated and experienced Senior Software Engineer, who is very used to working as a key member of a lean, Agile product development team. You will play an essential role in designing, building, enhancing and maintaining our bespoke client-facing software products using modern...

  • Data Engineer

    hace 5 días


    Sin especificar, España WeHunt España A tiempo completo

    Resumen del puestoData Engineer Empresa puntera en proyectos de Inteligencia Artificial y Big Data. Perfil buscado (H/M/D)Experiencia de al menos dos años en el desarrollo y despliegue de aplicaciones de procesamiento de datos en la nube con Azure.Conocimientos y experiencia en el ámbito de CI/CD y DevOpsExperiencia con Python y Java y/o Scala.Experiencia...


  • Sin especificar, España T-Systems Iberia A tiempo completo

    At T-Systems, you will find groundbreaking projects that contribute to social and ecological well-being. We want to welcome new talents like you, who bring fresh ideas, different perspectives, embrace challenges, and are committed to continuous learning in order to grow and make an impact on society.. all in a fun wayWe are currently looking for a Senior...


  • Sin especificar, España EarthStream A tiempo completo

    Senior Solution Engineer BESSHybrid/remote A very exciting opportunity has come up for an experienced Solution Engineer to join a global organsiation who are pushing the boundaries of innovation within the renewable energy space, and doing some very exciting work in the area of industrial energy storage systems (ESS/BESS).This organisation's products...

  • Senior Software Engineer

    hace 1 semana


    Sin especificar, España Vmmersion Studios A tiempo completo

    Company DescriptionVmmersion Studios is a small indie studio that creates immersive and boundary-breaking digital entertainment experiences. We strive to craft games that blend Eastern and Western cultures, inviting players from all backgrounds to explore diverse worlds. Our mission goes beyond entertainment; we aim to foster understanding, empathy, and...


  • Sin especificar, España CAS TRAINING A tiempo completo

    Senior Engineer AWS en 100% En remoto.CAS Training empresa de referencia con más de 20 años en consultoría tecnológica outsourcing y formación especializada selecciona un Senior Engineer AWS para formar parte de importante proyecto REMOTO.Perfil senior de ingería de datos con al mas de 5 años de experiencia mínima en arquitecturas AWS con datos en...

  • Senior Data Analyst

    hace 2 semanas


    Sin especificar, España Akkodis A tiempo completo

    Desde AKKODIS, multinacional de servicios tecnológicos y líder a nivel global, te estamos buscando a ti Estamos seleccionando un perfil de Senior Data Analyst para una posición híbrida en Madrid¿Qué buscamos? Experiencia de más de 5 años trabajando como Data AnalystExperiencia en reporting y análisis de datos.Experiencia en tratamiento de...

  • Data Engineer

    hace 3 días


    Sin especificar, España PrimeIT España A tiempo completo

    ¿Estás preparadx para un cambio y explotar tus habilidades como nunca? Sigue leyendo porque tenemos lo que buscas... ¿Quiénes somos? Somos una empresa internacional con más de 17 años de experiencia en consultoría e ingeniería informática.Con más de 2500 Primers operando en 4 sectores principales en todo el mundo: IT, Telecomunicaciones, Energía...

  • Senior Frontend Engineer

    hace 3 semanas


    Sin especificar, España Motive Group A tiempo completo

    Motive Group are supporting a scaling Barcelona based business with a Senior Frontend Engineer hire.We are looking for talented engineers with a minimum of 6 years in professional environments. (Ideally in fast growth startups or high growth businesses). You'll be at a Senior level, with experience mentoring talented junior and mid-level engineers, and...


  • Sin especificar, España eucalypto A tiempo completo

    SENIOR FULL STACK ENGINEER - END CLIENT - PRODUCT COMPANY (60k)Job Description:We are seeking a Senior Front End Fullstack Engineer with a strong expertise in JavaScript and TypeScript, as well as a solid foundation in Object Oriented Programming (OOP), SOLID principles, testing methodologies, and best coding practices. As a key member of our engineering...