Data Engineer

hace 3 días

Barcelona, España NDT Global A tiempo completo

NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as Acoustic Resonance (ART Scan) methodologies, the company also deploys a range of non-ultrasonic technologies, such as Inertial Measurement Units, with more under development. NDT Global strategically applies its inspection technologies to detect, diagnose and model various types of threat—circumferential or axial cracks, metal loss, geometry, mapping, and more—across diverse classes of assets. By providing predictive, decision-ready insights driven by the world’s most accurate data, NDT Global enables the conditions for asset owners to optimize infrastructure health and drive operational efficiencies while reducing risk and minimizing their carbon footprint.

Purpose
The goal of the Data Engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure. The role ensures, that architectural, test driven, and clean code principles are followed. This position also covers the design, setup, maintenance, and upgrade of the production environment.
Tasks
- Designs, specifies, and writes software code for different projects in Big Data environments
- Mentors, supports, and coaches colleagues, Data Scientists and Engineers in Big Data and Data Engineering topics
- Maintains software code and infrastructure in the Big Data environments
- Designs and prepares Big Data platform for machine learning and data processing in production environments
- Documents the work for the developed solutions and maintain consistency of information
- Responsible for the overall software and code base and implements the software code into production

**Requirements**:

- A bachelor's degree in computer science, Engineering or related education is required
- A minimum of 6 years of experience in Software Development and Big Data framework
- Advance experience in Scala, Apache Spark, Kafka and distributed storage systems (S3, Ceph)
- Experience with NoSQL Databases (Redis) and SQL Databases (MySQL, Microsoft SQL Server)
- Familiarity with cloud platforms (AWS or Azure) and their big data services (e.g., EMR, Databricks).
- Experience with Apache Nifi is a plus
- Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.

Skillset
- Must be proficient in spoken and written English
- Strong background in big data processing, data pipeline development, and performance optimization
- Excellent problem-solving skills and the ability to troubleshoot complex data issues
- Strong communication skills and the ability to work collaboratively in a team environment.

**Benefits**:

- Competitive salary and comprehensive benefits package: Health Insurance, pension Plan, Gym Flex, eyecare
- Opportunity to work with cutting-edge technologies and make a significant impact on our data strategy
- Opportunities for professional growth and development
- Flexible work arrangements, including remote work options

  • Data Engineer

    hace 7 días

    Barcelona, España Switch Tech Talent A tiempo completo

    Role: Data Engineer Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtInscríbase rápido, consulte la descripción completa desplazándose hacia abajo para conocer todos los requisitos de este puesto.We’re on the hunt for a talented Data...

  • Data Engineer

    hace 5 días

    Barcelona, España Switch Tech Talent A tiempo completo

    Role: Data Engineer Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtInscríbase rápido, consulte la descripción completa desplazándose hacia abajo para conocer todos los requisitos de este puesto.We’re on the hunt for a talented Data...

  • Data Engineer

    hace 1 día

    Barcelona, España Switch Tech Talent A tiempo completo

    Role:Data Engineer Salary:Up to €75,000 + equity Type:Permanent Location:Remote / Hybrid (Barcelona) Key Skills:SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtWe’re on the hunt for a talented Data Engineer to join our growing Data Team. In this role, you’ll drive the scaling and optimisation of data platforms and integrations,...

  • Data Engineer

    hace 7 días

    Barcelona, España Switch Tech Talent A tiempo completo

    Role: Data Engineer Desplácese hacia abajo para encontrar los detalles completos de la oferta de trabajo, incluyendo la experiencia requerida y las funciones y tareas asociadas. Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt We’re on the...

  • Data Engineer

    hace 6 días

    Barcelona, España Switch Tech Talent A tiempo completo

    Role: Data Engineer Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt Inscríbase rápido, consulte la descripción completa desplazándose hacia abajo para conocer todos los requisitos de este puesto. We're on the hunt for a talented Data...

  • Data Engineer

    hace 7 días

    Barcelona, España Switch Tech Talent A tiempo completo

    Role: Data Engineer Desplácese hacia abajo para encontrar los detalles completos de la oferta de trabajo, incluyendo la experiencia requerida y las funciones y tareas asociadas. Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt We’re on the...

  • Data Engineer

    hace 1 día

    barcelona, España Switch Tech Talent A tiempo completo

    Role: Data Engineer Desplácese hacia abajo para encontrar los detalles completos de la oferta de trabajo, incluyendo la experiencia requerida y las funciones y tareas asociadas. Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt We’re on the...

  • Data Engineer

    hace 1 día

    Barcelona, España Switch Tech Talent A tiempo completo

    We’re on the hunt for a talented Data Engineer to join our growing Data Team. In this role, you’ll drive the scaling and optimisation of data platforms and integrations, ensuring teams across the business have access to reliable, high-quality data for analytics and decision-making.What You’ll Do Build and maintain data pipelines feeding our Data...

  • Data Engineer

    hace 1 día

    Barcelona, España Switch Tech Talent A tiempo completo

    We’re on the hunt for a talented Data Engineer to join our growing Data Team. In this role, you’ll drive the scaling and optimisation of data platforms and integrations, ensuring teams across the business have access to reliable, high-quality data for analytics and decision-making.What You’ll DoBuild and maintain data pipelines feeding our Data...

  • Data Engineer

    hace 3 días

    Barcelona, España Switch Tech Talent A tiempo completo

    Role:Data EngineerSalary:Up to €75,000 + equityType:PermanentLocation:Remote / Hybrid (Barcelona)Key Skills:SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtWe're on the hunt for a talented Data Engineer to join our growing Data Team. In this role, you'll drive the scaling and optimisation of data platforms and integrations, ensuring teams...