Big Data Engineer
hace 2 meses
NDT Global Barcelona, Barcelona, Barcelona, Spain Job Description Posted Friday, May 17, 2024 at 4:00 AM NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.
Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as Acoustic Resonance (ART Scan) methodologies, the company also deploys a range of non-ultrasonic technologies, such as Inertial Measurement Units, with more under development.
NDT Global strategically applies its inspection technologies to detect, diagnose and model various types of threat—circumferential or axial cracks, metal loss, geometry, mapping, and more—across diverse classes of assets.
By providing predictive, decision-ready insights driven by the world's most accurate data, NDT Global enables the conditions for asset owners to optimize infrastructure health and drive operational efficiencies while reducing risk and minimizing their carbon footprint.
Purpose The goal of the Data Engineer is to architect, specify and implement data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure.
The role ensures that architectural, test driven, and clean code principles are followed.
This position also covers the design, setup, maintenance, and upgrade of the production environment.
Tasks Designs, specifies, and writes software code for different projects in Big Data environments Mentors, supports, and coaches colleagues, Data Scientists and Engineers in Big Data and Data Engineering topics Maintains software code and infrastructure in the Big Data environments Designs and prepares Big Data platform for machine learning and data processing in production environments Documents the work for the developed solutions and maintains consistency of information Responsible for the overall software and code base and implements the software code into production Performs code reviews and ensures quality of the developed software in production stage Requirements A bachelor's degree in computer science, Engineering or related education is required A minimum of 6 years of experience in Software Development and Big Data framework A minimum of 3 years of experience working with Big Data framework is required Advanced experience in Scala, Apache Spark, Kafka and distributed storage systems (S3, Ceph) Experience with NoSQL Databases (Redis) and SQL Databases (MySQL, Microsoft SQL Server) Familiarity with cloud platforms (AWS or Azure) and their big data services (e.g., EMR, Databricks) Experience with Apache Nifi is a plus Experience with containerization and orchestration tools (e.g., Docker, Kubernetes) is a plus Skillset Must be proficient in spoken and written English Knowledge of advanced programming skills (functional or object-oriented) Knowledge of Machine Learning is preferred Strong background in big data processing, data pipeline development, and performance optimization Excellent problem-solving skills and the ability to troubleshoot complex data issues Strong communication skills and the ability to work collaboratively in a team environment Benefits Competitive salary and comprehensive benefits package : Health Insurance, pension Plan, Gym Flex, eyecare, 23 days Annual leave Flexible & Hybrid working : Our flextime model allows you to design your working day as it suits your needs We think about the future : Individual training and development opportunities and professional development schemes Opportunity to work with cutting-edge technologies and make a significant impact on our data strategy International, intercultural and young working environment Great company culture and office environment #J-18808-Ljbffr
-
Big Data Engineer
hace 3 semanas
Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completoJob Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at NDT Global GmbH. The successful candidate will be responsible for designing, specifying, and implementing data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure.Key Responsibilities:Designs,...
-
Big Data Engineer
hace 4 semanas
Barcelona, Barcelona, España Ust Global A tiempo completoBig Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at UST Global. As a key member of our team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Spark and Scala.Key Responsibilities:Design and develop data processing pipelines using Spark and ScalaCollaborate with...
-
Big Data Engineer
hace 4 semanas
Barcelona, Barcelona, España Ust Global A tiempo completoBig Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at UST Global. As a key member of our team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Spark and Scala.Key Responsibilities:Design and develop data processing pipelines using Spark and ScalaCollaborate with...
-
Big Data Engineer
hace 3 semanas
Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completoJob DescriptionNdt Global Gmbh. is a leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Our company strategically applies its inspection technologies to detect, diagnose and model various types of...
-
Big Data Engineer
hace 2 semanas
Barcelona, España Ndt Global Gmbh. A tiempo completo.NDT Global Barcelona, Barcelona, Barcelona, Spain Job Description Posted Friday, May 17, 2024 at 4:00 AM NDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...
-
Big Data Engineer
hace 2 meses
Barcelona, España Ndt Global Gmbh. A tiempo completo.NDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...
-
Big Data Engineer
hace 2 meses
Barcelona, España Ndt Global Gmbh. A tiempo completoNDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...
-
Big Data Engineer
hace 2 meses
Barcelona, España Ndt Global Gmbh. A tiempo completoNDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...
-
Big Data Engineer
hace 3 semanas
Barcelona, España Ndt Global Gmbh. A tiempo completoNDT Global Barcelona, Barcelona, Barcelona, SpainJob DescriptionPosted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets.Recognized as the forerunner in...
-
Big Data Engineer
hace 5 meses
Barcelona, España NDT Global A tiempo completoNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in ultrasonic inspection technologies comprising Pulse Echo, Pitch-and-Catch and Phased Array, as well as...
-
Big Data Engineer
hace 2 meses
Barcelona, España Ndt Global Gmbh. A tiempo completoNDT Global Barcelona, Barcelona, Barcelona, SpainJob Description Posted Friday, May 17, 2024 at 4:00 AMNDT Global is the leading provider of ultra-high-tech diagnostic inspection solutions, advanced data analysis and integrity assessment services for ensuring the safety and longevity of energy-sector infrastructure assets. Recognized as the forerunner in...
-
Big Data Architect
hace 4 semanas
Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completoJob Title: Big Data EngineerNdt Global Gmbh is seeking a highly skilled Big Data Engineer to join our team.About the RoleThe successful candidate will be responsible for designing, specifying, and implementing data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure.Key ResponsibilitiesDesign and implement...
-
Big Data Architect
hace 4 semanas
Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completoJob Title: Big Data EngineerNdt Global Gmbh is seeking a highly skilled Big Data Engineer to join our team.About the RoleThe successful candidate will be responsible for designing, specifying, and implementing data access, ingestion, processing, and provisioning of large-scale datasets into the Big Data infrastructure.Key ResponsibilitiesDesign and implement...
-
Big Data, Barcelona
hace 5 meses
Barcelona, España Krell Consulting & Training A tiempo completoBig data en Barcelona.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake.Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo Tareas Principales Desarrollo y mantenimiento de la plataforma...
-
Big Data Architect
hace 4 semanas
Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completoJob Title: Big Data EngineerAt NDT Global, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, specifying, and implementing data access, ingestion, processing, and provisioning of large-scale datasets into our Big Data infrastructure.Key...
-
Big Data Architect
hace 4 semanas
Barcelona, Barcelona, España Ndt Global Gmbh. A tiempo completoJob Title: Big Data EngineerAt NDT Global, we are seeking a highly skilled Big Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, specifying, and implementing data access, ingestion, processing, and provisioning of large-scale datasets into our Big Data infrastructure.Key...
-
Big Data Engineer
hace 4 meses
Barcelona, España Mango A tiempo completoEn Mango inspiramos y unimos mediante nuestra pasión por el estilo y la cultura. Estamos en 118 países y nuestra presencia online se extiende a más de 80 países. Nuestro equipo está formado por personas de 112 nacionalidades y en un 80% por mujeres.Buscamos un/aBIG DATA ENGINEER**¿CÓMO SERÁ TU DÍA A DÍA EN MANGO?**Buscamos un/a Big Data Engineer...
-
Data Engineer in Big Data Infrastructure
hace 4 semanas
Barcelona, Barcelona, España cimne A tiempo completoAbout the Role:We are seeking a highly skilled Data Engineer to join our team at CIMNE in Lleida. As a Data Engineer in Big Data Infrastructure, you will be responsible for developing and maintaining our big data infrastructure, including data ingestion and harmonisation packages.Key Responsibilities:Design and implement scalable data systems using big data...
-
Data Engineer
hace 4 semanas
Barcelona, Barcelona, España Ravenpack A tiempo completoAbout UsRavenPack is a leading provider of big data analytics solutions for the financial industry. With 20 years of experience, we empower our clients to enhance returns, reduce risk, and increase efficiency by integrating public information into their models and workflows.Our MissionWe are committed to revolutionizing financial decision-making through the...
-
Data Engineer
hace 4 semanas
Barcelona, Barcelona, España Ravenpack A tiempo completoAbout UsRavenPack is a leading provider of big data analytics solutions for the financial industry. With 20 years of experience, we empower our clients to enhance returns, reduce risk, and increase efficiency by integrating public information into their models and workflows.Our MissionWe are committed to revolutionizing financial decision-making through the...
