Big Data Engineer

hace 1 día


Barcelona, España Ndt Global Gmbh. A tiempo completo

NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as Acoustic Resonance (ART Scan) methodologies, the company also deploys a range of non-ultrasonic technologies, such as Inertial Measurement Units, with more under development. NDT Global strategically applies its inspection technologies to detect, diagnose and model various types of threat—circumferential or axial cracks, metal loss, geometry, mapping, and more—across diverse classes of assets. By providing predictive, decision-ready insights driven by the world's most accurate data, NDT Global enables the conditions for asset owners to optimize infrastructure health and drive operational efficiencies while reducing risk and minimizing their carbon footprint.PurposeThe goal of the Data Engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure. The role ensures that architectural, test driven, and clean code principles are followed. This position also covers the design, setup, maintenance, and upgrade of the production environment.TasksDesigns, specifies, and writes software code for different projects in Big Data environmentsMentors, supports, and coaches colleagues, Data Scientists and Engineers in Big Data and Data Engineering topicsMaintains software code and infrastructure in the Big Data environmentsDesigns and prepares Big Data platform for machine learning and data processing in production environmentsDocuments the work for the developed solutions and maintains consistency of informationResponsible for the overall software and code base and implements the software code into productionPerforms code reviews and ensures quality of the developed software in production stageRequirementsA bachelor's degree in computer science, Engineering or related education is requiredA minimum of 6 years of experience in Software Development and Big Data frameworkA minimum of 3 years of experience working with Big Data framework is requiredAdvanced experience in Scala, Apache Spark, Kafka and distributed storage systems (S3, Ceph)Experience with NoSQL Databases (Redis) and SQL Databases (MySQL, Microsoft SQL Server)Familiarity with cloud platforms (AWS or Azure) and their big data services (e.g., EMR, Databricks)Experience with Apache Nifi is a plusExperience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plusSkillsetMust be proficient in spoken and written EnglishKnowledge of advanced programming skills (functional or object-oriented)Knowledge of Machine Learning is preferredStrong background in big data processing, data pipeline development, and performance optimizationExcellent problem-solving skills and the ability to troubleshoot complex data issuesStrong communication skills and the ability to work collaboratively in a team environmentBenefitsCompetitive salary and comprehensive benefits package: Health Insurance, pension Plan, Gym Flex, eyecare, 23 days Annual leaveFlexible & Hybrid working: Our flextime model allows you to design your working day as it suits your needsWe think about the future: Individual training and development opportunities and professional development schemesOpportunity to work with cutting-edge technologies and make a significant impact on our data strategyInternational, intercultural and young working environmentGreat company culture and office environment
#J-18808-Ljbffr



  • Barcelona, España Oxigent Technologies A tiempo completo

    Big Data Engineer en Barcelona.¿Te interesaría seguir desarrollándote como Data Engineer en un multinacional alemana líder en el sector retail utilizando tecnología puntera dentro de un equipo de profesionales de primer nivel y en un entorno colaborativo donde proponer ideas?Desde Oxigent Technologies seleccionamos un/a MID-LEVEL DATA ENGINEER para...

  • Big Data Engineer

    hace 2 meses


    Barcelona, España Ndt Global A tiempo completo

    .NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big Data Engineer

    hace 1 día


    Barcelona, España Ndt Global Gmbh. A tiempo completo

    .NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...

  • Big Data Engineer

    hace 1 mes


    Barcelona, España Ndt Global A tiempo completo

    NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big Data Engineer

    hace 1 mes


    Barcelona, España Ndt Global A tiempo completo

    NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big Data Engineer

    hace 3 días


    Barcelona, España Ndt Global Gmbh. A tiempo completo

    NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...

  • Big Data Engineer

    hace 3 días


    Barcelona, España Ndt Global Gmbh. A tiempo completo

    NDT Global Barcelona, Barcelona, Barcelona, SpainJob Description Posted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...

  • Big Data Engineer

    hace 1 día


    Barcelona, España Ndt Global Gmbh. A tiempo completo

    NDT Global Barcelona, Barcelona, Barcelona, Spain Job Description Posted Friday, May 17, 2024 at 4:00 AM NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in...

  • Big Data Engineer

    hace 4 meses


    Barcelona, España NDT Global A tiempo completo

    NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big Data Engineer

    hace 1 mes


    Barcelona, España Mango A tiempo completo

    .En Mango inspiramos y unimos mediante nuestra pasión por el estilo y la cultura. Estamos en 118 países y nuestra presencia online se extiende a más de 80 países. Nuestro equipo está formado por personas de 112 nacionalidades y en un 80% por mujeres.Buscamos un/aBIG DATA ENGINEER**¿CÓMO SERÁ TU DÍA A DÍA EN MANGO?**Buscamos un/a Big Data Engineer...


  • Barcelona, España Oxigent Technologies A tiempo completo

    Big Data Engineer en Barcelona.¿Te interesaría seguir desarrollándote como Data Engineer en un multinacional alemana líder en el sector retail utilizando tecnología puntera dentro de un equipo de profesionales de primer nivel y en un entorno colaborativo donde proponer ideas?Desde Oxigent Technologies seleccionamos un/a MID-LEVEL DATA ENGINEER para...


  • Barcelona, España Oxigent Technologies A tiempo completo

    Big Data Engineer en Barcelona.¿Te interesaría seguir desarrollándote como Data Engineer en un multinacional alemana líder en el sector retail utilizando tecnología puntera dentro de un equipo de profesionales de primer nivel y en un entorno colaborativo donde proponer ideas?Desde Oxigent Technologies seleccionamos un/a MID-LEVEL DATA ENGINEER para...

  • Big Data Engineer

    hace 3 meses


    Barcelona, España Mango A tiempo completo

    En Mango inspiramos y unimos mediante nuestra pasión por el estilo y la cultura. Estamos en 118 países y nuestra presencia online se extiende a más de 80 países. Nuestro equipo está formado por personas de 112 nacionalidades y en un 80% por mujeres.Buscamos un/aBIG DATA ENGINEER**¿CÓMO SERÁ TU DÍA A DÍA EN MANGO?**Buscamos un/a Big Data Engineer...

  • Big Data Engineer

    hace 1 mes


    Barcelona, España Gaming Innovation Group A tiempo completo

    As part of the Big Data Team, you will be using cutting edge technologies to work on collating data across different sources within GiG.Sources are all in real time, and you will be supporting an event driven micro service lambda architecture.Your focus is to work with the current agile team and contribute to the platform's objectives, enabling many other...


  • Barcelona, España Zurich Insurance A tiempo completo

    Our opportunityWe are seeking an Engineer to join our Enterprise Data Analytics & Architecture (EDAA) organization within Group Operations Business Transformation.Your roleAs a Big Data Engineer, your main responsibilities will involve:Development of data processing pipelines using Spark/Scala.Development of tests using Spark/Scala.Hands-on development and...

  • Big Data Engineer

    hace 3 semanas


    Barcelona, Barcelona, España Gaming Innovation Group A tiempo completo

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Gaming Innovation Group. As a key member of our Big Data Team, you will be responsible for designing, developing, and maintaining large-scale data processing systems to support our business objectives.Key ResponsibilitiesDesign and implement data pipelines using Apache Spark...

  • Big Data Engineer

    hace 3 semanas


    Barcelona, Barcelona, España Gaming Innovation Group A tiempo completo

    About the RoleWe are seeking a highly skilled Big Data Engineer to join our team at Gaming Innovation Group. As a key member of our Big Data Team, you will be responsible for designing, developing, and maintaining large-scale data processing systems to support our business objectives.Key ResponsibilitiesDesign and implement data pipelines using Apache Spark...


  • Barcelona, España Centre Internacional de Mètodes Numèrics a l'Enginyeria (CIMNE) A tiempo completo

    Centre Internacional de Mètodes Numèrics a l'Enginyeria (CIMNE). 1 plaça de Data Engineer in big data Infrastructure. Concurs oposició o valoració de mèrits i prova. Laboral temporal. 2024-09-18. Termini obert. A1 - Grau universitari (correspondència amb llicenciatures). Llicenciat o màster en Informàtica, Enginyeria del Programari o en un camp...


  • Barcelona, España Santander A tiempo completo

    Job Title: Big Data Engineer Data Lake (Openbank) Country: Spain WHAT YOU WILL BE DOING Openbank is in the middle of a digital transformation, working in startup format and innovating in core banking product development from within.We want to convey a whole new digital experience to our customers and for that reason we need the most skilled professionals to...

  • Big Data Engineer

    hace 3 meses


    Barcelona, España Catalarrhh A tiempo completo

    Empresa tecnológica, especializada en ofrecer soluciones IT para el sector sanitario y hospitalario, precisa incorporar a u su equipo de profesionales a un/a BIG DATA ENGINEER**.** **Skills**: - Ability to work in a team - Communication skills - Ability to learn and adapt to new technologies - Ability to program AI solutions that have a web...