Senior Data Engineer

hace 3 semanas

En remoto, España Frontiers A tiempo completo

We are on a mission to make science open so everyone can live healthy lives on a healthy planet

Who we are

Frontiers is an award-winning open science platform and leading open access scholarly publisher.
We are one of the largest and most cited publishers globally. To date, our 200,000 freely available research articles have received more than 1 billion views and downloads and 2 million citations. Our journals span science, health, humanities and social sciences, engineering, and sustainability. And we continue to expand into new academic disciplines so more researchers can publish open access.
Be part of the publishing revolution and help us transform the way research is published, evaluated, and communicated to the world.

The Role
To empower scientists and radically improve how science is published, evaluated and disseminated to researchers, innovators and the public, we have built our own state-of-the-art Artificial Intelligence Review Assistant (AIRA). Data is at the heart of AIRA in the form of AIRA Knowledge - a rich graph of academic knowledge such as scientific publications, citation relationships between those publications, as well as authors, institutions and fields of research. This serves as the basis of all the AI/ML models used by our reviewer recommendation service and our quality checks.
Additionally, we have created a Cloud Data Warehouse, that allows integrating information coming from our editorial platform and external sources from the publishing industry to calculate real-time insights and feed cutting-edge machine learning algorithms.
We are now looking for a passionate Senior Data Engineer / Data Architect to join our growing team and help us evolve AIRA Knowledge and our Cloud Data Warehouse.

Key Responsibilities
As a Data Engineer, you will be responsible for optimising or even re-designing AIRA Knowledge’s data architecture to support our next generation of product features and data initiatives. You will be expanding and optimising our data pipeline architecture, as well as optimising data flow and collection for AIRA.
You will support the teams to implement solutions, pipelines, and integrations over our Cloud Data Warehouse.

Tech Stack & Key Requirements:

- Proven experience as a Data Engineer
- Databricks (Python & Spark or PySpark)
- Experience with ETLs/ELT
- Experience with Data Modelling
- Understanding of big data principles and ability to implement these (volume, velocity, variety, veracity and value)
- Expertise in data processing
- Ability to prioritise
- Familiarity with Agile framework
- Good English skills

Nice to have
- Experience with a Cloud Platform (e.g. Azure, AWS, GCP)
- Experience with a workflow engine (e.g. Data Factory, Airflow)

Your Main responsibilities:

- Design, implement, monitor, and optimize our data platforms to meet the data pipeline needs
- Integrate, transform, and consolidate data from various structured and unstructured data systems into structures that are suitable for building analytics solutions
- Understand and promote the best Data frameworks and solutions, technical standards and key technologies, to effectively support existing and future business requirements
- Collaborate closely with Machine Learning and Data Science Team to improve the performance of our ML pipelines

**Benefits**:
With more than 50 nationalities represented in our global team, you will work regularly with teammates in other countries, and with our community of researchers, editors, and authors from around the globe.
Our mission to create solutions for healthy lives also extends to the working environment we provide for our employees.

This includes:
100% remote working
Employees now have the flexibility to choose where they want to work, with remote working available on a part
- or full-time basis (not applicable to some Workplace/IT jobs due to nature of role requiring presence onsite, in the office).

Learning and development
All employees have access to LinkedIn Learning (and Pluralsight for our technology team), an annual personal learning budget, and dedicated L&D time.

Wellbeing
We offer free online yoga classes, an employee assistance plan, access to the Headspace app, and four wellbeing days on top of your annual leave allowance.

Volunteering opportunities
Employees can dedicate three days each year to volunteer for a personal cause or through our volunteering partner platform, Alaya.
- Frontiers actively embraces diversity and is a safe and welcoming workplace. Recruitment is free from discrimination - including based on race, national or ethnic origin, age, religion, disability, sex, gender identity or sexual orientation. With over 600 employees from more than 50 different nations, our diversity creates vibrant teams and constantly challenges us to appreciate multiple perspectives._

  • Senior Data Engineer

    hace 4 días

    En remoto, España Polar Analytics A tiempo completo

    **About Polar Analytics**: Polar Analytics is a Full-Stack Business Intelligence Solution for Consumer Brands. A powerful, yet simple solution for business users to get the insights they need to succeed and make the right decisions. Our mission is to empower indie DTC brands worldwide to grow faster and more profitably! **What we’re looking for**: We're...

  • Data Engineer Senior

    hace 3 semanas

    En remoto, España CAS TRAINING A tiempo completo

    Data Engineer Senior ( Inglés ) Remoto en 100% En remoto. Seleccionamos para proyecto que se desarrolla en remoto un perfil senior de ingenieria de datos con al menos 3-4 experiência en arquitecturas Azure Databricks Synapse Datafactory SQL Database. - Aportar mínimo 3 años de experiência en proyectos como Ingeniero de datos en arquitecturas Azure...

  • Senior Data Engineer

    hace 4 semanas

    En remoto, España AirHelp A tiempo completo

    You will be working with a seasoned and highly motivated, multi-cultural team of Data Engineers, DataOps Data Scientists, and Data Analysts. You will have the challenge of supporting the business’ needs in a changing environment and helping AirHelp reach the next level of data maturity. You will work with the team in designing, building, and maintaining...

  • Arquitecto Senior Aws/ Data

    hace 6 días

    En remoto, España Krell Consulting A tiempo completo

    Sistemas- CLOUD( AZURE, AWS, Google)- hace 2 horas**Descripción**: - Krell consulting busca incorporar a su equipo Senior Architect AWS- Arquitecto senior con amplia experiência en servicios AWS orientados a data (Glue, S3, EMR). Muy valorable también conocimiento IaC y CDK.- Rol: cross entre diferentes proyectos/iniciativas, referencia técnica AWS,...

  • Data Engineer

    hace 5 días

    En remoto, España Nextail A tiempo completo

    At Nextail, you will be part of a cross-functional and autonomous team where you will build cloud components for the company. **Our team**: You will be part of the Data Platform team. Some of the coworkers from our teams are: Carlos Varela (Senior Architect) Dario Cazás (Architect) David Fernández (Data Engineer) Ana Prior (Software...

  • Senior Data Engineer

    hace 6 días

    En remoto, España SeQura A tiempo completo

    **_Creating the payment platform shoppers love._** Hi there! We are **SeQura**, an innovative, fast-growing fintech company based in sunny Barcelona, born in 2013, seeking to be _the preferred payment platform, helping people buy things they love, paying in an instant, fair and flexible way_. **Humanizing financial services** is our main mantra, and...

  • Data Engineer

    hace 3 días

    En remoto, España Facebook App A tiempo completo

    How would Facebook scale to the next billion users? The Infrastructure Strategy group is responsible for the strategic analysis to support and enable the continued growth critical to Facebook’s infrastructure organization. We are looking for a Data Engineer to not only build data pipelines but also extend the next generation of our data tools. As a Data...

  • DevOps Senior Engineer

    hace 3 semanas

    En remoto, España Bismart A tiempo completo

    **¡Buscamos un DevOps Senior Engineer para trabajar totalmente en remoto!**: Bismart busca un DevOps Senior Engineer para incorporarse a un importante proyecto internacional del sector de la automoción. El trabajo es **a tiempo completo y totalmente remoto**. ¿Quieres formar parte de esta experiência? ¡Sigue leyendo! - FuncionesFormarás parte de la...

  • Data Engineer, 100% en Remoto

    hace 3 semanas

    En remoto, España Akuaro A tiempo completo

    Data Engineer en 100% En remoto. ¿Eres Data Engineer? Lee esta oportunidad Uno de nuestros partners está buscando un Data Engineer que se incorpore al equipo. La empresa es una consultora de servicios y soluciones tecnológicas española en donde trabajan unas 500 personas. Buscan un ingeniero de datos que tenga experiência en procesos de extracción de...

  • Data Engineer con Pyspark

    hace 2 semanas

    En remoto, España Aratech A tiempo completo

    Descripción Somos ARATECH, una consultora tecnológica, nacida hace 10 años para aportar soluciones eficientes a nuestros clientes. Dentro de nuestras líneas de negocio ayudamos a nuestros socios a encontrar el mejor talento para sus equipos de trabajo. ¿Te gustaría seguir desarrollando tu carrera en una empresa que gestiona grandes proyectos? ¿Te...

  • Junior Data Engineer

    hace 5 días

    En remoto, España Nextail A tiempo completo

    At Nextail, you will be part of a cross-functional and autonomous team where you will build cloud components for the company. **Our team**: You will be part of the Data Platform team. Some of the coworkers from our teams are: Carlos Varela (Senior Architect) Rosa Ferrando (Senior Software Engineer) Pablo Axeitos (Senior Software...

  • Senior DevOps Operations Engineer, 100% en Remoto

    hace 3 semanas

    En remoto, España Grupo NS A tiempo completo

    Senior DevOps Operations Engineer en 100% En remoto. Desde Grupo NS estamos seleccionando un perfil Senior DevOps Operations Engineer para un proyecto de una gran multinacional alemana de automoción Buscamos un ambicioso ingeniero de Operaciones DevOps que mantenga y evolucione la arquitectura DevOps de una innovadora aplicación para la Conducción...

  • Data Engineer

    hace 4 semanas

    En remoto, España IQVIA A tiempo completo

    **Data Engineer** **Flexible location: Spain, Portugal, Slovakia, Romania, Bulgaria (fully remote)** **Overview**: We’re looking for a Data Engineer to help us designing and building systems for collecting, storing, and analyzing data at scale, enabling our Data Scientists/Analysts/BI teams to automate and scale data analytics processes and solve data...

  • Data Engineer Remoto, 100% en Remoto

    hace 6 días

    En remoto, España CAS TRAINING A tiempo completo

    Data engineer Remoto en 100% En remoto. CAS training selecciona a varios perfiles de Data engineer con experiência en ETL y AWS para proyecto remoto data, etl,aws

  • Data Ops Engineer

    hace 4 días

    En remoto, España Red Commerce A tiempo completo

    **Data OPs Engineer / Remote from EU / 8 months / Start ASAP** **Project description**: We are looking for a detail-oriented Data Integration Engineer with expertise in Amazon Redshift and EXASOL. This role demands sound knowledge of AWS landscape and responsibilities would include performing migration activities during pilot phase, developing reusable...

  • Elastic Stack Data Engineer

    hace 6 días

    En remoto, España Krell Consulting A tiempo completo

    BI/Big Data- Arquitecto Datos- hace 2 horas**Descripción**: - ¿QUÉ TALENTO BUSCAMOS?Para importante cliente top del sector IT, precisamos incorporar un perfil de Data Engineer con las siguientes características: - Perfil: Experto ELK Data Engineer - Cliente: Banca - Funciones: Administrar la plataforma elastic en ITOps. Necesitamos este perfil para...

  • Data Engineer

    hace 4 semanas

    En remoto, España S2 Grupo A tiempo completo

    Descripción En S2 Grupo desarrollamos algunas de las herramientas más avanzadas del país para la detección de amenazas y gestión de incidentes de ciberseguridad apoyándose en una intensa y sostenida actividad de I+D+i. Bucamos un/a DATA ENGINEER para incorporarse a nuestro equipo de Operaciones. **Funciones**: - Analizar datos procedentes de la...

  • Data Quality Engineer

    hace 4 días

    En remoto, España Red Commerce A tiempo completo

    **Data Quality Engineer / Remote in EU / 8 month minimum contract / Start ASAP** **Project description**: - Definition of test plan and test strategy - Execution of data reconciliation verification - Development of migration verification sections of runbook **Requirements**: - Expertise in Amazon Redshift and EXASOL - Strong experience in AWS landscape -...

  • Data Engineer Aws Remoto, 100% en Remoto

    hace 4 días

    En remoto, España CAS TRAINING A tiempo completo

    Data engineer AWS Remoto en 100% En remoto. CAS training selecciona a varios perfiles de Data engineer para diversos proyectos Se requiere experiência en PYTHON O SCALA Entornos AWS EXperiencia en Pyspark data, aws, python,scala,pyspark,

  • Data Engineer

    hace 3 semanas

    En remoto, España CMV Consultores A tiempo completo

    Data Engineer (Cloud) en 100% En remoto. CMV Consultores es una empresa de Servicios de IT dedicada fundamentalmente a la selección de profesionales con perfiles técnicos. Asimismo ofrece a sus clientes servicios de asesoría y soporte en la implantación de soluciones tecnológicas y desarrollo de aplicaciones. ¿Estás buscando una nueva oportunidad o un...