DATA ENGINEER
hace 2 semanas
Job description EURECAT - Technology Center of Catalonia is seeking a highly motivated DATA ENGINEER for its Data Science & Big Data Analytics Technological Unit . FUNCTIONS AND RESPONSIBILITIES OF THE JOB: · Design and deploy data pipelines for bringing data and control metadata lineage from different source systems to a data warehousing system, including queue management and real-time data processing. · Architect reusable software practices using state of the art orchestration systems such as Airflow or Dagster and containerization stack such as Docker or Kubernetes. · Deploy data sharing and cataloguing existing software tools to enable Data Spaces through standard building blocks from IDSA, Gaia-X and Fiware. · Contribute to Machine Learning projects by adopting technologies for data storing, serving and versioning capabilities from blob-Storage to traditional SQL solutions and NoSQL. · Assist the unit in multi-cloud deployments (Amazon Web Services, Azure and Google Cloud Platform). · When applicable, deploy and design Big Data Architectures including batch and streaming paradigms such as Flink, Spark Structured Streaming, Kafka, and the Hadoop Ecosystem. · Project management and technical lead in EU funded and private projects. Writing proposals for Horizon Europe calls (excellence, task description…) Requirements REQUIREMENTS: Studies · MsC in Computer Science. Other technical background will also be considered (Engineer, Mathematics, Physics, etc.) and PhD or Masters in this field will be highly valuated. Experience · Database Systems (MySQL, PostgreSQL, MongoDB, ElasticSearch, Cassandra DB, Redis) · Implementation of data catalogues (CKAN), data brokers and data connectors (DSSC, Eclipse, Fiware) · Airflow and Python based E(L)TL data pipelines. · Cloud providers technological stack (Serverless functions, Virtual Computing Resources, Storage). · Software patterns best practices as well as knowledge from Data Mining and Machine Learning. · Languages and programming tools (Python, Java, Scala, SQL, C/C++, Git, Docker) · DevOps knowledge and experience in Linux is a big plus, specially deploying and maintaining big data infrastructures using Ambari or Ansible. · Interest in Research, Innovation & Patent Publication, Conference Presentations, Prototyping, Full Lifecycle Product Development. Languages · Excellent written and oral communication skills in English. · Catalan and/or Spanish would be desirable. WHAT CAN EURECAT OFFER YOU? Permanent contract. Hybrid work (home office/ work in the office). Flexible Schedule. Shorter workday on Friday and Summer Schedule. Flexible remuneration package (health insurance, transport, lunch, studies - training and kindergarten). Eurecat employees can join the Eurecat Academy courses. Language courses (English, Catalan and Spanish).
-
Data Engineer/BI Engineer
hace 1 semana
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare.Our mission? To offer technological, business, strategy, application...
-
Data Engineer/BI Engineer
hace 2 semanas
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us.Consulte la descripción del puesto a continuación. Si confía en que tiene las habilidades y la experiencia adecuadas, envíe su solicitud hoy mismo.A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial...
-
Data Engineer/BI Engineer
hace 7 días
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare.Our mission? To offer technological, business, strategy, application...
-
Data Engineer/BI Engineer
hace 5 días
barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare. Our mission? To offer technological, business, strategy, application...
-
Data Engineer/BI Engineer
hace 1 semana
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare.Our mission? To offer technological, business, strategy, application...
-
Data Engineer
hace 2 semanas
Barcelona, España SGF Global A tiempo completo**Data Engineer (Hybrid)** **Barcelona, Spain** SGF Global is looking for a Data Engineer, for ITenterprise in Barcelona - Spain. **Requirements**: - Strong knowledge of Microsoft BI development stack -SQL Integration Services/SQL Server/T-SQL Development (>2 years experience) - Extensive experience as DB developer/data engineer (>2 years experience) - Good...
-
Data Engineer/BI Engineer
hace 2 semanas
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare.Sea uno de los primeros solicitantes, lea la descripción completa del...
-
Data Engineer/BI Engineer
hace 2 semanas
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare. Si está considerando enviar una solicitud, asegúrese de pulsar el botón...
-
Data Engineer/BI Engineer
hace 2 semanas
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare. Si está considerando enviar una solicitud, asegúrese de pulsar el botón...
-
Data Engineer: Databricks, PySpark
hace 2 semanas
barcelona, España NTT DATA, Inc. A tiempo completoA leading global IT services firm is seeking a Data Engineer to join their team in Barcelona, Spain. The ideal candidate will have expertise in building scalable data pipelines and processing large datasets using Databricks and Apache Spark. You will be responsible for designing NoSQL schemas, data orchestration with Delta Lake, and leading junior engineers....
