Big Data Engineer

hace 2 semanas

Barcelona, España NDT Global A tiempo completo

NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as Acoustic Resonance (ART Scan) methodologies, the company also deploys a range of non-ultrasonic technologies, such as Inertial Measurement Units, with more under development. NDT Global strategically applies its inspection technologies to detect, diagnose and model various types of threat—circumferential or axial cracks, metal loss, geometry, mapping, and more—across diverse classes of assets. By providing predictive, decision-ready insights driven by the world’s most accurate data, NDT Global enables the conditions for asset owners to optimize infrastructure health and drive operational efficiencies while reducing risk and minimizing their carbon footprint.

NDT Global is part of Previan, a fast-growing, innovative industrial technology group focused on advanced diagnostic technologies to monitor the world’s infrastructure health. The Group serves asset owners, large engineering firms, and service companies globally in markets such as Aerospace, Civil Infrastructures, Energy, Mining, Power Generation, and Rail. Previan believes that advancing science and technology via sensors, hardware, robotics, and software makes the world more productive and safer for people, business and nature. The company employs over 1,300 people throughout 28 offices worldwide and serves clients in more than 110 countries

Purpose

The goal of the Big Data Engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure. The role ensures, that architectural, test driven, and clean code principles are followed. This position also covers the design, setup, maintenance, and upgrade of the production environment.

Tasks
- Designs, specifies, and writes software code for different projects in Big Data environments
- Mentors, supports, and coaches colleagues, Data Scientists and Engineers in Big Data and Data Engineering topics
- Maintains software code and infrastructure in the Big Data environments
- Designs and prepares Big Data platform for machine learning and data processing in production environments
- Documents the work for the developed solutions and maintain consistency of information
- Responsible for the overall software and code base and implements the software code into production

**Requirements**:

- A Bachelor's degree in Computer Science, Engineering or related education is required
- A minimum of 6 years of experience in Software Development and Big Data framework
- Must be proficient in spoken and written English
- Advance experience in Scala, Apache Spark, Kafka and distributed storage systems (S3, Ceph)
- Experience with NoSQL Databases (Redis) and SQL Databases (MySQL, Microsoft SQL Server)
- Experience working in cloud environments (AWS or Azure)
- Experience with Apache Nifi is a plus

**Benefits**:

- Attractive compensation system
- Health Insurance
- Pension Plan
- Gym Flex
- Eyecare
- Flexible working environment (60% remote, 40% office)

  • Big Data Engineer

    hace 7 días

    Barcelona, España Gaming Innovation Group A tiempo completo

    Big Data Engineer Department: Technology Employment Type: Full Time Location: Barcelona Reporting To: Vronsky Bartolo Description As part of GiG's growth strategy, we are establishing a dedicated Migrations Team to lead the migration of brands from legacy systems and other platforms into our modern GiG CoreX platform. In the role of Migration Engineer, you...

  • Big Data Engineer

    hace 1 semana

    Barcelona, España NDT Global A tiempo completo

    NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...

  • Big data, Barcelona

    hace 2 semanas

    Barcelona, España Krell Consulting & Training A tiempo completo

    Big dataEstamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake.Se espera que tenga experiencia en Scala y PowerShell, así como en Big Data y desarrollo de software, con al menos 7 años de experiencia en el campo Tareas Principales: Desarrollo y mantenimiento de la plataforma Datalake.Entrega...

  • Big Data Engineer

    hace 20 horas

    Barcelona, España JR Spain A tiempo completo

    En OPTIMISSA tenemos claro que el éxito de nuestros proyectos se debe a las personas que forman nuestro equipo. Por eso, si tienes amplia experiencia como Big Data Engineer, nos comprometemos a impulsar tu talento, satisfacer tus expectativas laborales y hacerte sentir como en casa. ¿Quieres construir hoy el mundo de mañana? ¡Sigue leyendo!Big Data...

  • Data Engineer

    hace 6 días

    Barcelona, España The BIG Jobsite A tiempo completo

    Data Engineer – BarcelonaAbout the companyJoin a fast-growing global tech unicorn transforming how teams connect and work in real life. With a collaborative, in-person-first culture, you'll be part of a forward-thinking organisation that values innovation, autonomy, and impact.About the roleWe're looking for a Data Engineer to scale our Data Team...

  • DATA ENGINEER

    hace 2 semanas

    Barcelona, España Eurecat A tiempo completo

    Job description EURECAT - Technology Center of Catalonia  is seeking a highly motivated DATA ENGINEER  for its Data Science & Big Data Analytics Technological Unit . FUNCTIONS AND RESPONSIBILITIES OF THE JOB: · Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system,...

  • Big Data Engineer

    hace 2 semanas

    Barcelona, Barcelona, España Gaming Innovation Group A tiempo completo

    Big Data EngineerDepartment: TechnologyEmployment Type: Full TimeLocation: BarcelonaReporting To: Vronsky BartoloDescription As part of GiG's growth strategy, we are establishing a dedicated Migrations Team to lead the migration of brands from legacy systems and other platforms into our modern GiG CoreX platform. In the role of Migration Engineer, you will...

  • DATA ENGINEER

    hace 20 horas

    Barcelona, España Eurecat - Technology Centre A tiempo completo

    Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2,000 companies. Applied R&D, technological services, highly specialized training, technological consultancy or...

  • DATA ENGINEER

    hace 5 días

    Barcelona, España Eurecat - Technology Centre A tiempo completo

    Eurecat is the main Research & Technology Organisation in Catalonia and the second largest private research organization in southern Europe. It brings together the experience of more than 700 professionals and provides services to more than 2,000 companies. Applied R&D, technological services, highly specialized training, technological consultancy or...

  • Remote Data Engineer

    hace 2 semanas

    Barcelona, España Mática Partners A tiempo completo

    Una empresa innovadora en Big Data busca un Data Engineer con hasta un año de experiencia. Las responsabilidades incluyen el desarrollo de pipelines ETL en Azure y la colaboración con equipos para traducir requisitos de negocio. Ofrecen un contrato indefinido, salario entre 22.000 € y 26.000 € anuales, con beneficios como horario flexible, formación...