Data Engineer

hace 2 semanas

En remoto, España Facebook App A tiempo completo

How would Facebook scale to the next billion users? The Infrastructure Strategy group is responsible for the strategic analysis to support and enable the continued growth critical to Facebook’s infrastructure organization.

We are looking for a Data Engineer to not only build data pipelines but also extend the next generation of our data tools. As a Data Engineer, you will develop a clear sense of connection with our organization and leadership - as Data Engineering is the eyes through which they see the product.

This is a partnership-heavy role. As a member of Infrastructure Strategy Data Engineering, you will belong to a centralized Data Science/Data Engineering team who partners closely with teams in Facebook’s Infrastructure organization. Through the consulting-nature of our team, you will contribute to a variety of projects and technologies, depending on partner needs. Projects include analytics, ML modeling, tooling, services, and more. The broad range of partners equates to a broad range of projects and deliverables: ML Models, datasets, measurements, services, tools and process.

**Data Engineer Responsibilities**:

- Partner with leadership, engineers, program managers and data scientists to understand data needs.
- Design, build and launch extremely efficient and reliable data pipelines to move data across a number of platforms including Data Warehouse, online caches and real-time systems.
- Communicate, at scale, through multiple mediums: Presentations, dashboards, company-wide datasets, bots and more.
- Educate your partners: Use your data and analytics experience to ‘see what’s missing’, identifying and addressing gaps in their existing logging and processes.
- Leverage data and business principles to solve large scale web, mobile and data infrastructure problems.
- Build data expertise and own data quality for your areas.

**Minimum Qualifications**:

- 5+ years of Python development experience.
- 5+ years of SQL experience.
- 3+ years of experience with workflow management engines (i.e. Airflow, Luigi, Prefect, Dagster, digdag.io, Google Cloud Composer, AWS Step Functions, Azure Data Factory, UC4, Control-M).
- 3+ years experience with Data Modeling.
- Experience analyzing data to discover opportunities and address gaps.
- 5+ years experience in custom ETL design, implementation and maintenance.
- Experience working with cloud or on-prem Big Data/MPP analytics platform(i.e. Netezza, Teradata, AWS Redshift, Google BigQuery, Azure Data Warehouse, or similar).

**Preferred Qualifications**:

- Experience with more than one coding language.
- Experience with designing and implementing real-time pipelines.
- Experience with data quality and validation.
- Experience with SQL performance tuning and E2E process optimization.
- Experience with anomaly/outlier detection.
- Experience with notebook-based Data Science workflow.
- Experience with Airflow.
- Experience querying massive datasets using Spark, Presto, Hive, Impala, etc.

  • Data Engineer

    hace 1 semana

    En remoto, España IQVIA A tiempo completo

    **Data Engineer** **Flexible location: Spain, Portugal, Slovakia, Romania, Bulgaria (fully remote)** **Overview**: We’re looking for a Data Engineer to help us designing and building systems for collecting, storing, and analyzing data at scale, enabling our Data Scientists/Analysts/BI teams to automate and scale data analytics processes and solve data...

  • Data Engineer

    hace 1 día

    En remoto, España WeDoData (Bristol) Ltd A tiempo completo

    **Data Engineer** ¿Quieres trabajar para una empresa dinámica, llamativa e inclusiva? ¿Uno que ofrece increíbles beneficios como viajes de esquí a lujosas estancias en Ibiza? Unite al start-up localizado en Munich y en Barcelona. Empezaron en 2020 y en tan solo tiempo ya tienen un equipo de 150 profesionales de ML Engineers, Data Scientits y...

  • Data Engineer SQL Remoto, 100% en Remoto

    hace 1 semana

    En remoto, España CAS TRAINING A tiempo completo

    Data Engineer SQL remoto en 100% En remoto. Cas training selecciona a dos Data Engineer SQL con experiência en SQL Server 2008/2014/2019 administración BBDD T-SQL ETL/ELT Data modelling (Kimball) TFS Git Microsoft Change Tracker Star Snowflake Schema Tecnologías opcionales Data Vault V2 Airflow Python Batch/PowerShell Scripting Power BI Tabular OLAP...

  • Data Engineer

    hace 2 semanas

    En remoto, España K-LAGAN A tiempo completo

    ¡En **K-LAGAN** te estamos esperando para continuar creciendo juntos! Somos una empresa estratégica internacional de servicios tecnológicos, comprometida esencialmente con su equipo y con la sociedad. Ofrecemos soluciones en servicios IT, desarrollos de ingeniería, de electrónica, y proyectos de I+D. Nuestro compromiso es contratar a los mejores...

  • Data Platform Engineer

    hace 1 semana

    En remoto, España EXCELIA A tiempo completo

    Buscamos un/a Data Platform EngineerUbicación: RemotoEstamos buscando un perfil técnico senior para diseñar, implementar y gestionar un Data Marketplace sobre IBM Cloud Pak for Data (CP4D), así como su interoperabilidad con Databricks y otras plataformas de datos. La persona seleccionada se incorporará a un equipo de proyecto y podrá trabajar desde sus...

  • Data Engineer Scala/spark, 100% en Remoto

    hace 1 semana

    En remoto, España PSS A tiempo completo

    Data Engineer Scala/Spark en 100% En remoto. Somos un equipo profesional de más de 600 personas aportando nuestro talento en proyectos del sector Banca y Seguros Telecomunicaciones Energía Retail y Utilities tanto en el ámbito público como privado. Buscamos data engineer con experiência en el desarrollo de Scala/Spark para trabajar dentro del...

  • Data Engineer Spark/scala

    hace 1 día

    En remoto, España ToBeIT A tiempo completo

    ¡Hola! Desde ToBeIT estamos buscando un Data Engineer Spark/Scala, para trabajar en una de las principales compañías de consultoría tecnológica 100% remoto. **Funciones**: Ingesta y procesamiento de datos con Spark y Scala. **Requisitos obligatorios**: At least 2 years experience working with big data (spark, hadoop, hive, kafka). At least 2 year...

  • Data Engineer Snowflake

    hace 1 semana

    En remoto, España CAS TRAINING A tiempo completo

    Data Engineer Snowflake & DBT ( Remoto ) en 100% En remoto. Seleccionamos para proyecto del sector industria que se desarrolla en remoto un Data Engineer con SnowFlake DBT 1-3 años de experiência contrastada en diseño de soluciones y desarrollo de procesos de datos (ingesta transformación y disponibilización para consumo) en entorno cloud AWS. 1-3...

  • Machine Learning

    hace 4 días

    En remoto, España Nextail A tiempo completo

    We’re looking to add an experienced ML/Data Engineer to our Data Science team. This new team member will be instrumental in leading and developing data science solutions from the idea to maturity as we continue to make the retail world a better, more sustainable place. At Nextail, we empower retailers to create better experiences while using fewer of the...

  • Data & Analytics Engineer

    hace 3 días

    En remoto, España Tangelo Games A tiempo completo

    For over a decade, Tangelo Games has been dedicated to making a positive impact on people's lives, and our passion drives us to continue this mission. As a collective of enthusiastic gamers and developers, we don't just craft games; we forge connections. Whether through our vibrant multiplayer gaming community, 'Mundigames,' or our company ethos that...