Big Data Engineer
hace 2 semanas
NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as Acoustic Resonance (ART Scan) methodologies, the company also deploys a range of non-ultrasonic technologies, such as Inertial Measurement Units, with more under development. NDT Global strategically applies its inspection technologies to detect, diagnose and model various types of threat—circumferential or axial cracks, metal loss, geometry, mapping, and more—across diverse classes of assets. By providing predictive, decision-ready insights driven by the world’s most accurate data, NDT Global enables the conditions for asset owners to optimize infrastructure health and drive operational efficiencies while reducing risk and minimizing their carbon footprint.
Purpose
The goal of the Data Engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure. The role ensures, that architectural, test driven, and clean code principles are followed. This position also covers the design, setup, maintenance, and upgrade of the production environment.
Tasks
- Designs, specifies, and writes software code for different projects in Big Data environments
- Mentors, supports, and coaches colleagues, Data Scientists and Engineers in Big Data and Data Engineering topics
- Maintains software code and infrastructure in the Big Data environments
- Designs and prepares Big Data platform for machine learning and data processing in production environments
- Documents the work for the developed solutions and maintain consistency of information
- Responsible for the overall software and code base and implements the software code into production
- Performs code reviews and ensure quality of the developed software in production stage
**Requirements**:
- A bachelor's degree in computer science, Engineering or related education is required
- A minimum of 6 years of experience in Software Development and Big Data framework
- A minimum of 3 years of experience working with Big Data framework is required
- Advance experience in Scala, Apache Spark, Kafka and distributed storage systems (S3, Ceph)
- Experience with NoSQL Databases (Redis) and SQL Databases (MySQL, Microsoft SQL Server)
- Familiarity with cloud platforms (AWS or Azure) and their big data services (e.g., EMR, Databricks).
- Experience with Apache Nifi is a plus
- Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus.
Skillset
- Must be proficient in spoken and written English
- Knowledge of advanced programming skills (functional or object-oriented) is required
- Knowledge of Machine Learning is preferred
- Strong background in big data processing, data pipeline development, and performance optimization
- Excellent problem-solving skills and the ability to troubleshoot complex data issues
- Strong communication skills and the ability to work collaboratively in a team environment.
**Benefits**:
- Competitive salary and comprehensive benefits package: Health Insurance, pension Plan, Gym Flex, eyecare, 23 days Annual leave
- Flexible & Hybrid working: Our flextime model allows you to design your working day as it suits your needs
- We think about the future: Individual training and development opportunities and professional development schemes
- Opportunity to work with cutting-edge technologies and make a significant impact on our data strategy
- International, intercultural and young working environment.
- Great company culture and office environment
-
Big Data Solutions Engineer
hace 4 días
Barcelona, Barcelona, España NDT Global GmbH. A tiempo completoRole OverviewThe Senior Big Data Engineer will play a critical role in designing and implementing Big Data solutions that meet the needs of our organization. This includes:Designing, specifying, and writing software code for different projects in Big Data environmentsMentoring, supporting, and coaching colleagues, Data Scientists, and Engineers in Big Data...
-
Senior Big Data Engineer
hace 3 semanas
Barcelona, España Talent Hackers A tiempo completoAs a Big Data Engineer, you will be responsible for Ofertia’s big data platform and collaboration with Mediapost on common projects. Develop and optimize ETL processes by working closely with multiple data partners and stakeholders across the company to meet the growing business needs. Act as Big Data evangelist to drive innovation and design technical...
-
Big Data Engineer
hace 17 horas
Barcelona, España Mango A tiempo completoEn Mango inspiramos y unimos mediante nuestra pasión por el estilo y la cultura.Estamos en 118 países y nuestra presencia online se extiende a más de 80 países.Nuestro equipo está formado por personas de 112 nacionalidades y en un 80% por mujeres.Buscamos un/aBIG DATA ENGINEER¿CÓMO SERÁ TU DÍA A DÍA?Big Data Engineer para que se incorpore a nuestro...
-
Big Data Engineer
hace 5 días
Barcelona, España Talent A tiempo completoGFT es una compañía pionera en transformación digital que desarrolla soluciones sostenibles basadas en nuevas tecnologías, como la inteligencia artificial y blockchain/DLT. Los expertos de GFT crean e implementan aplicaciones de software escalables que hacen que el acceso a modelos de negocio innovadores sea seguro y sencillo.Actualmente tenemos un...
-
Big Data Engineer
hace 4 semanas
Barcelona, España Ndt Global A tiempo completoNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...
-
Big Data Engineer
hace 4 semanas
Barcelona, España Ndt Global A tiempo completoNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...
-
Senior Software Engineer
hace 5 días
Barcelona, Barcelona, España Talent A tiempo completoJob DescriptionThe Data Engineer role is a critical component of our Big Data infrastructure team. The successful candidate will be responsible for designing, specifying, and implementing data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure.ResponsibilitiesDesigns, specifies, and writes software code...
-
Big Data Engineer
hace 3 semanas
Barcelona, España NDT Global A tiempo completoNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...
-
Big Data Engineer
hace 4 semanas
Barcelona, España Ndt Global A tiempo completoNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...
-
Big Data Engineer
hace 6 días
Barcelona, España JR Spain A tiempo completoSocial network you want to login/join with:Client:SERIT ConsultingLocation:Barcelona, SpainJob Category:OtherEU work permit required:YesJob Reference:827106975172421222432460Job Views:2Posted:10.02.2025Expiry Date:27.03.2025Job Description:Serit is looking for a Big Data Engineer with:5+ years in Big Data developmentExpertise in Hadoop, Spark,...
-
Big Data Engineer
hace 4 semanas
Barcelona, España BSP executive A tiempo completo**¿Dónde trabajarás?**: You will join a Multicultural Company where you will get to play out your skills. **¿Qué harás?**: At Data Performance team, we are building Intel Data Store (IntelDS), a global Data Lake for enterprise data. It is a Big Data platform fully hosted on AWS and connected today to more than 40 data sources. The job purpose is to...
-
Big Data Engineer
hace 2 semanas
Barcelona, España Jr Spain A tiempo completoSocial network you want to login/join with:Client:SERIT ConsultingLocation:Barcelona, SpainJob Category:OtherEU work permit required:YesJob Reference:827106975172421222432460Job Views:2Posted:10.02.2025Expiry Date:27.03.2025Job Description:Serit is looking for a Big Data Engineer with:5+ years in Big Data developmentExpertise in Hadoop, Spark,...
-
Big Data Engineer
hace 2 semanas
Barcelona, España Jr Spain A tiempo completoSocial network you want to login/join with: Client: SERIT Consulting Location: Barcelona, Spain Job Category: Other EU work permit required: Yes Job Reference: 827106975172421222432460 Job Views: 2 Posted: 10.02.2025 Expiry Date: 27.03.2025 Job Description: Serit is looking for a Big Data Engineer with: 5+ years in Big Data development Expertise in Hadoop,...
-
Big Data Engineer
hace 6 días
Barcelona, España GFT Group A tiempo completoGFT es una compañía pionera en transformación digital que desarrolla soluciones sostenibles basadas en nuevas tecnologías, como la inteligencia artificial y blockchain/DLT. Los expertos de GFT crean e implementan aplicaciones de software escalables que hacen que el acceso a modelos de negocio innovadores sea seguro y sencillo.Actualmente tenemos un...
-
Big Data Engineer
hace 6 días
Barcelona, España GFT Group A tiempo completoGFT es una compañía pionera en transformación digital que desarrolla soluciones sostenibles basadas en nuevas tecnologías, como la inteligencia artificial y blockchain/DLT. Los expertos de GFT crean e implementan aplicaciones de software escalables que hacen que el acceso a modelos de negocio innovadores sea seguro y sencillo.Actualmente tenemos un...
-
SENIOR BIG DATA ENGINEER
hace 5 días
Barcelona, España Talent A tiempo completoNDT Global Barcelona, Barcelona, SpainJob DescriptionNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse...
-
Senior Big Data Engineer
hace 3 semanas
Barcelona, España NDT Global A tiempo completoNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...
-
Senior Big Data Engineer
hace 4 días
Barcelona, España Ndt Global Gmbh. A tiempo completoNDT Global Barcelona, Barcelona, SpainJob DescriptionNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse...
-
Senior Big Data Engineer
hace 4 días
Barcelona, España Ndt Global Gmbh. A tiempo completoNDT Global Barcelona, Barcelona, SpainJob DescriptionNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse...
-
Senior Big Data Engineer
hace 5 días
Barcelona, España Talent A tiempo completoNDT Global Barcelona, Barcelona, SpainJob DescriptionNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse...
