Dataops Engineer
hace 2 días
.WHAT YOU CAN EXPECT At our unit "Data Foundation - Big Data Management" we aim to offer organizations a robust and scalable solution for managing and deriving insights from vast quantities of data.
By utilizing Azure's PaaS components, our platform streamlines the deployment and handling of Big Data workloads, empowering our clients to make data-driven decisions and propel business expansion.
Our team is accountable for the creation and upkeep of the Big Data platform built on Azure PaaS components EDL (Enterprise Data Lake).
We collaborate intensively with stakeholders to comprehend their needs and devise solutions that fulfill their expectations.
The team is also in charge of guaranteeing the platform's scalability, dependability, and security, and for staying abreast with the newest technologies and trends in the big data domain.
About the Job: We are seeking a highly motivated and detail-oriented candidate who will be responsible for the development of new and existing software and data pipelines with Python and Databricks and maintaining/developing CI/CD pipelines and processes in an ambitious team.
RESPONSIBILITIES Develop, analyse, improve and test quality software to meet both user and internal needs.
Experience developing data pipelines, troubleshooting and implementing data quality control measures to ensure data's accuracy and consistency.
Work in cloud environment (Azure and Databricks).
Collaborate with users and the data science team to understand their data needs and provide suitable solutions.
Test new features and improvements and suggest their implementation if beneficial.
Demonstrate fluent communication skills in English (spoken and written).
QUALIFICATIONS Bachelor's degree in computer science, Information Technology, Engineering, Business, or related fields.
Minimum 3-4 years related working experience as DataOps Engineer using Azure, Python, Azure Data Factory and Databricks.
Strong software engineering and development skills with Python and Git.
Experience with Databricks and Azure's cloud environment.
Experience with databases, data structures and data manipulation.
Experience in an Agile way of working with a DevOps mindset.
Knowledge in automation & scripting with tools like Azure DevOps pipelines, etc.
In-depth know how with Big Data concepts and Databricks.
Team player with strong interpersonal, written, and verbal communication skills.
NICE TO HAVE Experience with event streaming, message brokers and other event driven architectures (Kafka, RabbitMQ, etc.)
and familiarity with Big Data concepts.
Ideally, managing and operating solutions via command line utilities and working to improve automation and enlist modern practises (DevOps, CI/CD, Terraform, etc).
Integration knowledge between Data Catalog Collibra and Big Data Platforms.
Ideally, backed up by vendor certifications (e.G.
Microsoft, Linux)
-
Dataops Engineer
hace 3 días
Madrid, España Aderen A tiempo completoID de Job Opening- 1945- Duración del proyecto meses- Largo Plazo- Idiomas- Español- Área de conocimiento- Habilidades- Azure, SSIS- Tarifa Candidato- 220-250- Descripción del empleo**BUSCAMOS**: DataOps Engineer**Perfil**Profesional con Experiência contrastada desempeñando el rol de DataOps Engineer**Funciones & Tareas**- Integración de la gestión...
-
(Xu179) - Dataops Engineer
hace 2 días
Madrid, España Ares Consultores A tiempo completoID de Job Opening- 1945- Duración del proyecto: meses- Largo Plazo- Idiomas: Español- Área de conocimiento: Habilidades- Azure, SSIS- Tarifa Candidato: 220-250Descripción del empleoBUSCAMOS: DataOps EngineerPerfilProfesional con experiencia contrastada desempeñando el rol de DataOps Engineer.Funciones & TareasIntegración de la gestión de datos a nivel...
-
Dataops Engineer
hace 3 días
Madrid, España Ares Consultores A tiempo completoID de Job Opening- 1945- Duración del proyecto: meses- Largo Plazo- Idiomas: Español- Área de conocimiento: Habilidades- Azure, SSIS- Tarifa Candidato: 220-250 Descripción del empleo BUSCAMOS : DataOps Engineer Perfil Profesional con experiencia contrastada desempeñando el rol de DataOps Engineer.Funciones & Tareas Integración de la gestión de datos a...
-
Dataops
hace 3 días
Madrid, España Zemsania A tiempo completoDescripciónEn Zemsania, estamos en la búsqueda de un/a **DataOps Engineer** con experiência para un proyecto en el sector bancario.Trabajarás para uno de nuestros principales clientes, una empresa multinacional líder en el mercado con presencia en más de 50 países y operaciones en diversos sectores, incluyendo telecomunicaciones, banca, industria,...
-
(Xu179) - Dataops Engineer
hace 3 días
Madrid, España Ares Consultores A tiempo completoID de Job Opening1945Duración del proyecto: mesesLargo PlazoIdiomas: EspañolÁrea de conocimiento: HabilidadesAzure, SSISTarifa Candidato: 220-250Descripción del empleo BUSCAMOS : DataOps EngineerPerfil Profesional con experiencia contrastada desempeñando el rol de DataOps Engineer.Funciones & Tareas Integración de la gestión de datos a nivel...
-
Vjt590 Dataops Engineer
hace 2 días
Madrid, España Aderen A tiempo completoID de Job Opening- 1945- Duración del proyecto meses- Largo Plazo- Idiomas- Español- Área de conocimiento- Habilidades- Azure, SSIS- Tarifa Candidato- 220-250- Descripción del empleoBUSCAMOS : DataOps EngineerPerfil Profesional con experiencia contrastada desempeñando el rol de DataOps EngineerFunciones & Tareas Integración de la gestión de datos a...
-
Dataops Engineer
hace 2 días
Madrid, España Ares Consultores A tiempo completoID de Job Opening- 1945- Duración del proyecto: meses- Largo Plazo- Idiomas: Español- Área de conocimiento: Habilidades- Azure, SSIS- Tarifa Candidato: 220-250Descripción del empleoBUSCAMOS: DataOps EngineerPerfilProfesional con experiencia contrastada desempeñando el rol de DataOps Engineer.Funciones TareasIntegración de la gestión de datos a nivel...
-
Dataops Engineer
hace 3 días
Madrid, España Ares Consultores A tiempo completoID de Job Opening1945Duración del proyecto: mesesLargo PlazoIdiomas: EspañolÁrea de conocimiento: HabilidadesAzure, SSISTarifa Candidato: 220-250Descripción del empleo BUSCAMOS : DataOps EngineerPerfil Profesional con experiencia contrastada desempeñando el rol de DataOps Engineer.Funciones & Tareas Integración de la gestión de datos a nivel...
-
Senior DataOps Engineer
hace 3 días
Madrid, España Idoven A tiempo completoAbout UsIdoven has developed the world’s first cardiology-as-a-service platform powered by artificial intelligence that augments both a cardiologist’s and non-cardiology expert clinician’s ability to identify, triage and diagnose patients at scale.The company counts partners such as AstraZeneca, Abbott, and GE Healthcare, FIFPRO, Google, Santander and...
-
Data Engineer
hace 3 días
Madrid, España Tecdata Engineering A tiempo completoRequisitos indispensables: Título universitario en informática, tecnología de la información, ingeniería, negocios o campos relacionados.Mínimo 4-5 años de experiencia relacionada como DataOps Engineer utilizando Azure, Python, Azure Data Factory y Databricks.Fuertes habilidades de ingeniería de software y desarrollo con Python y Git.Experiencia con...
-
(Dd406) - Dataops Engineer
hace 2 días
Madrid, España Ares Consultores A tiempo completoMissionThe main responsibilities are:Data modeling and pipelines development with Spark on Scala in order to ingest and transform data from several sources (Kafka topics, APIs, HDFS, structured databases…).Data transformation and quality to ensure data consistency and accuracy.Set up CI/CD pipelines to automate deployments, unit testing and development...
-
(Dd406) - Dataops Engineer
hace 2 días
Madrid, España Ares Consultores A tiempo completoMissionThe main responsibilities are:Data modeling and pipelines development with Spark on Scala in order to ingest and transform data from several sources (Kafka topics, APIs, HDFS, structured databases…).Data transformation and quality to ensure data consistency and accuracy.Set up CI/CD pipelines to automate deployments, unit testing and development...
-
(Dd406) - Dataops Engineer
hace 3 días
Madrid, España Ares Consultores A tiempo completoMissionThe main responsibilities are:Data modeling and pipelines development with Spark on Scala in order to ingest and transform data from several sources (Kafka topics, APIs, HDFS, structured databases...).Data transformation and quality to ensure data consistency and accuracy.Set up CI/CD pipelines to automate deployments, unit testing and development...
-
Dataops Engineer
hace 3 días
Madrid, España Inetum Spain A tiempo completoJob Description We're Hiring: Data Engineer Join our international and agile digital consultancy!We are looking for a skilled Data Engineer to join our team in a hybrid work model based in Madrid .If you're passionate about data pipelines , cutting-edge technologies , and creating a positive impact, this role is for you.About the Role As a Data Engineer, you...
-
Dataops Engineer
hace 2 días
Madrid, España Empresa Reconocida A tiempo completo.ABOUT US : At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF´s position as the digital leader in the chemical industry.We believe the right path is through creativity, trial and error and great people...
-
Dataops Engineer
hace 4 horas
Madrid, España Empresa Reconocida A tiempo completo.ABOUT US: At BASF Digital Hub Madrid we develop innovative digital solutions for BASF, create new exciting customer experiences and business growth, and drive efficiencies in processes, helping to strengthen BASF ´s position as the digital leader in the chemical industry.We believe the right path is through creativity, trial and error and great people...
-
Data Engineer
hace 6 días
Madrid, España Q-tech A tiempo completo¿Tienes un perfil deData Engineercon experiencia en bases de datos y pasión por la automatización de procesos? ¡Únete a un proyecto transformador que está revolucionando la industria de lasexperiencias olfativas !Estamos buscando un/aData Operations Engineerde nivel medio a senior, con la posibilidad de evolucionar hacia un rol de expert@ en Data...
-
Dataops Engineer
hace 2 días
Madrid, España Basf Se A tiempo completoWHAT YOU CAN EXPECTAt our unit "Data Foundation - Big Data Management" we aim to offer organizations a robust and scalable solution for managing and deriving insights from vast quantities of data.By utilizing Azure's PaaS components, our platform streamlines the deployment and handling of Big Data workloads, empowering our clients to make data-driven...
-
Cloud Data Engineer Madrid · Híbrido
hace 3 días
Madrid, España Tecdata Engineering A tiempo completoRequisitos indispensables:Título universitario en informática, tecnología de la información, ingeniería, negocios o campos relacionados.4 años de experiencia relacionada como DataOps Engineer utilizando Azure, Python, Azure Data Factory y Databricks.Fuertes habilidades de ingeniería de software y desarrollo con Python y Git.Experiencia con Spark o...
-
Solo Quedan 24H Dataops Engineer
hace 3 días
Madrid, España Basf Se A tiempo completo.WHAT YOU CAN EXPECTAt our unit "Data Foundation - Big Data Management" we aim to offer organizations a robust and scalable solution for managing and deriving insights from vast quantities of data.By utilizing Azure's PaaS components, our platform streamlines the deployment and handling of Big Data workloads, empowering our clients to make data-driven...