Big Data Engineer

hace 2 meses

Barcelona, España Ndt Global Gmbh. A tiempo completo

NDT Global Barcelona, Barcelona, Barcelona, Spain
Job DescriptionPosted Friday, May 17, 2024 at 4:00 AM
NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as Acoustic Resonance (ART Scan) methodologies, the company also deploys a range of non-ultrasonic technologies, such as Inertial Measurement Units, with more under development. NDT Global strategically applies its inspection technologies to detect, diagnose and model various types of threat—circumferential or axial cracks, metal loss, geometry, mapping, and more—across diverse classes of assets. By providing predictive, decision-ready insights driven by the world's most accurate data, NDT Global enables the conditions for asset owners to optimize infrastructure health and drive operational efficiencies while reducing risk and minimizing their carbon footprint.
Purpose The goal of the Data Engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure. The role ensures that architectural, test driven, and clean code principles are followed. This position also covers the design, setup, maintenance, and upgrade of the production environment.
Tasks Designs, specifies, and writes software code for different projects in Big Data environmentsMentors, supports, and coaches colleagues, Data Scientists and Engineers in Big Data and Data Engineering topicsMaintains software code and infrastructure in the Big Data environmentsDesigns and prepares Big Data platform for machine learning and data processing in production environmentsDocuments the work for the developed solutions and maintains consistency of informationResponsible for the overall software and code base and implements the software code into productionPerforms code reviews and ensures quality of the developed software in production stageRequirements A bachelor's degree in computer science, Engineering or related education is requiredA minimum of 6 years of experience in Software Development and Big Data frameworkA minimum of 3 years of experience working with Big Data framework is requiredAdvanced experience in Scala, Apache Spark, Kafka and distributed storage systems (S3, Ceph)Experience with NoSQL Databases (Redis) and SQL Databases (MySQL, Microsoft SQL Server)Familiarity with cloud platforms (AWS or Azure) and their big data services (e.g., EMR, Databricks)Experience with Apache Nifi is a plusExperience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plusSkillset Must be proficient in spoken and written EnglishKnowledge of advanced programming skills (functional or object-oriented)Knowledge of Machine Learning is preferredStrong background in big data processing, data pipeline development, and performance optimizationExcellent problem-solving skills and the ability to troubleshoot complex data issuesStrong communication skills and the ability to work collaboratively in a team environmentBenefits Competitive salary and comprehensive benefits package: Health Insurance, pension Plan, Gym Flex, eyecare, 23 days Annual leaveFlexible & Hybrid working: Our flextime model allows you to design your working day as it suits your needsWe think about the future: Individual training and development opportunities and professional development schemesOpportunity to work with cutting-edge technologies and make a significant impact on our data strategyInternational, intercultural and young working environmentGreat company culture and office environment
#J-18808-Ljbffr

  • Big Data Engineer

    hace 1 mes

    Barcelona, España Ndt Global Gmbh. A tiempo completo

    .NDT Global Barcelona, Barcelona, Barcelona, Spain Job Description Posted Friday, May 17, 2024 at 4:00 AM NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...

  • Big Data Engineer

    hace 2 meses

    Barcelona, España Ndt Global Gmbh. A tiempo completo

    .NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...

  • Cloud Data Engineer

    hace 2 semanas

    Barcelona, Barcelona, España Data Privacy A tiempo completo

    About the TeamOur team at ALOHAS is comprised of individuals who share a passion for innovation and growth.We value creativity, proactivity, and good communication, and we strive to create an environment where everyone feels comfortable and motivated.The JobWe are seeking a Cloud Data Engineer - Big Data Expert who will be responsible for designing and...

  • Big Data Engineer

    hace 1 mes

    Barcelona, España Ndt Global Gmbh. A tiempo completo

    NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in...

  • Big Data Engineer

    hace 2 semanas

    Barcelona, España NDT Global A tiempo completo

    NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big Data Engineer

    hace 2 meses

    Barcelona, España Ndt Global Gmbh. A tiempo completo

    NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...

  • Big Data Engineer

    hace 6 meses

    Barcelona, España NDT Global A tiempo completo

    NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big Data Engineer

    hace 2 meses

    Barcelona, España Ndt Global Gmbh. A tiempo completo

    NDT Global Barcelona, Barcelona, Barcelona, Spain Job Description Posted Friday, May 17, 2024 at 4:00 AM NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in...

  • Big Data, Barcelona

    hace 3 días

    Barcelona, España Krell Consulting & Training A tiempo completo

    Big data Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake.Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo Tareas Principales Desarrollo y mantenimiento de la plataforma Datalake.Entrega...

  • Big Data, Barcelona

    hace 5 meses

    Barcelona, España Krell Consulting & Training A tiempo completo

    Big data en Barcelona.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake.Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo Tareas Principales Desarrollo y mantenimiento de la plataforma...

  • Big Data Engineer

    hace 5 meses

    Barcelona, España Mango A tiempo completo

    En Mango inspiramos y unimos mediante nuestra pasión por el estilo y la cultura. Estamos en 118 países y nuestra presencia online se extiende a más de 80 países. Nuestro equipo está formado por personas de 112 nacionalidades y en un 80% por mujeres.Buscamos un/aBIG DATA ENGINEER**¿CÓMO SERÁ TU DÍA A DÍA EN MANGO?**Buscamos un/a Big Data Engineer...

  • Data Engineer in Big Data Infrastructure

    hace 1 mes

    Barcelona, Barcelona, España cimne A tiempo completo

    About the Role:We are seeking a highly skilled Data Engineer to join our team at CIMNE in Lleida. As a Data Engineer in Big Data Infrastructure, you will be responsible for developing and maintaining our big data infrastructure, including data ingestion and harmonisation packages.Key Responsibilities:Design and implement scalable data systems using big data...

  • Data Engineer

    hace 2 semanas

    Barcelona, Barcelona, España Lastminute Group A tiempo completo

    Lastminute Group, a leading European travel tech company, is seeking an experienced Data Engineer to join its Sales & Partnerships team. This role will be responsible for designing and building data pipelines that enable the company to make informed decisions and drive business growth.About the Role:We are looking for a skilled engineer who can work with...

  • Plaça de Data Engineer in Big Data Infrastructure

    hace 3 meses

    Barcelona, España Centre Internacional de Mètodes Numèrics a l'Enginyeria (CIMNE) A tiempo completo

    Centre Internacional de Mètodes Numèrics a l'Enginyeria (CIMNE). 1 plaça de Data Engineer in big data Infrastructure. Concurs oposició o valoració de mèrits i prova. Laboral temporal. 2024-09-18. Termini obert. A1 - Grau universitari (correspondència amb llicenciatures). Llicenciat o màster en Informàtica, Enginyeria del Programari o en un camp...

  • Big Data Engineer – Data Lake

    hace 2 meses

    Barcelona, España Santander A tiempo completo

    Job Title: Big Data Engineer Data Lake (Openbank) Country: Spain WHAT YOU WILL BE DOING Openbank is in the middle of a digital transformation, working in startup format and innovating in core banking product development from within.We want to convey a whole new digital experience to our customers and for that reason we need the most skilled professionals to...

  • Big Data Engineer – Data Lake

    hace 2 días

    Barcelona, España buscojobs España A tiempo completo

    Job Title : Big Data Engineer Data Lake (Openbank)Country : SpainWHAT YOU WILL BE DOINGOpenbank is in the middle of a digital transformation, working in startup format and innovating in core banking product development from within.We want to convey a whole new digital experience to our customers and for that reason we need the most skilled professionals to...

  • Data Architect

    hace 2 semanas

    Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completo

    About NDT GlobalNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased...

  • Big Data Engineer

    hace 2 semanas

    Barcelona, España Garaje De Ideas A tiempo completo

    Lo que buscamos es… Una persona que se incorpore a nuestro equipo de Data como Big Data Engineer especializado en BigQuery.Será la persona responsable de la construcción de los pipelines de datos, desarrollando principalmente en Google Cloud.Y en concreto, esto es lo que harás: Resolver problemas complejos, aportando soluciones adecuadas y...

  • Senior Big Data Engineer

    hace 3 días

    Barcelona, Barcelona, España Microsoft A tiempo completo

    Company Overview:Microsoft is a world-renowned technology company that fosters innovation, collaboration, and career growth. Our cloud-enabled environment offers endless possibilities for passionate innovators to envision and achieve their goals.Job Summary:We are seeking an experienced Senior Big Data Engineer to join our Azure Data engineering team,...

  • Data Engineer, Hibrido

    hace 6 meses

    Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo. data, Scala, PowerShell,