Data Engineer with Python
hace 2 semanas
Contractor role; US-based company.We operate remotely - most of the Engineering team is CET.Our data team collects large-scale web and API data to power these insights.We have a small, focused group that owns source coverage and freshness. The Data Acquisition Lead sets priorities and reviews complex fixes; the Data Engineer maintains schemas, pipelines, and SLAs. Your focus is 80 percentweb data collection and spider reliability; You will keep pipelines healthy, support internal users, and run QA checks so data stays accurate at all times. This is an early-career role with significant growth.80 percent - Spiders and data collection Build and maintain spiders and API collectors in Python/JavaScript; Write validation checks and source-level QA to prevent bad data from entering the warehouse. Adjust small Python or SQL transformations when a source output changes. raise and resolve data quality issues. Collaborate with Data Engineers on schemas and idempotent loads into the warehouse. Provide lightweight technical support to internal consumers.Follow legal and ethical guidelines for data collection; respect terms, privacy, and access controls. Communicate clearly in English with engineers and non-technical stakeholders.Our stack (you do not need all of it) Node.js in JavaScript or TypeScript; Proxy providers: integration and rotation, residential or datacenter, country targeting, session stickiness. Cloud Run or Cloud Functions, Pub/Sub, Cloud Storage, Cloud Scheduler. Data: BigQuery or Postgres fundamentals, CSV or Parquet handling. personal projects or internships are fine. Core web fundamentals:headers and cookies, session handling, JSON APIs, simple auth flows. Comfortable in Node.js and TypeScript or JavaScript; Experience with other web crawling frameworks, for example Scrapy, is valued and a plus. Schedule and orchestrate runs reliably using Cloud Scheduler and Airflow or Mage where appropriate, with clear SLAs and alerting.Basic SQL; comfort reading or writing simple queries for QA. Experience with GitHub Actions, Docker, and simple cost-aware choices on GCP. Exposure to data quality checks or anomaly detection.30 days:ship your first spider, add monitoring and a QA checklist, fix a real breakage end to end. ~Real impact on a data product used by operators. Fully remote with EU and US overlap; Learn from senior engineers and grow toward data engineering or platform paths.if possible one example of a scraper you built and what it collected.
-
Data Engineer Python PySpark SQL
hace 3 días
Madrid, España The BIG Jobsite A tiempo completoData Engineer (Python PySpark SQL) Madrid onsite to €120,000Do you have a first class education combined with Data Engineering skills?You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive growth potential.As a Data Engineer you'll be instrumental in...
-
Data Engineer
hace 1 semana
Madrid, España We Bring A tiempo completo**_¿Te gustaría formar parte de un equipo ágil y colaborativo, que trabaja con últimas tecnologías y tiene ganas de aprender todos los días?_** Desde **We Bring** estamos seleccionando para su incorporación en una empresa tecnológica y referente internacional en el sector bancario a un/a **Data Engineer (Python) en Madrid.** **¿CUÁL ES EL STACK...
-
Data Engineer Python PySpark SQL
hace 3 días
Madrid, España WhatJobs A tiempo completoData Engineer (Python PySpark SQL) Madrid onsite to €120,000 Do you have a first class education combined with Data Engineering skills? You could be progressing your career at a start-up Investment Management firm that have secure backing, an established Hedge Fund client as a partner and massive growth potential. As a Data Engineer you'll be instrumental...
-
Python Developer
hace 4 días
Madrid, España Insight International (UK) Ltd A tiempo completoRole: Data Engineer Location: Barcelona, Spain Job Type: PermanentMission: A Data Engineer is responsible for designing, building, and maintaining large-scale data systems that enable data-driven decision-making. They work with various stakeholders to understand data requirements, data architectures, and implement data pipelines to support business...
-
Data Engineer Python, Madrid
hace 2 semanas
Madrid, España Grupo NS A tiempo completoData Engineer Python en Madrid. Desde Grupo NS estamos seleccionando perfiles Data Engineer para un proyecto de larga duración y modalidad remoto con reuniones puntuales en Madrid. Dominio de Python y/o SAS Nível de licenciatura o ingeniería o superior Deseable Diseñar y evaluar la calidad de los datos (y el gobierno de los datos) Diseñar e...
-
Data Engineer with Databricks
hace 2 días
Madrid, España Movilges Intersoft A tiempo completoWe are recruiting a **Data Engineer with Databricks** to strengthen our team with the possibility of working on a remote basis. **What we are looking for**: - Data engineeer with at least 3 year experience in: - Arquitecture design in Azure Data bricks: data modeling, best practice software architecture, workflow design for performance optimization; -...
-
AWS Data Engineer: Python, Spark
hace 2 semanas
Madrid, España Keepler Data Tech A tiempo completoUna empresa en el sector de tecnología de datos busca un Data Engineer con experiencia en entornos AWS. El candidato ideal debe poseer habilidades en Python y Apache Airflow, además de tener un nivel de inglés B2-C1. Se ofrece teletrabajo flexible, horario adaptable y un presupuesto para formación anual. La compañía promueve el desarrollo continuo y...
-
AWS Data Engineer: Python, Spark
hace 1 semana
Madrid, España Keepler Data Tech A tiempo completoUna empresa en el sector de tecnología de datos busca un Data Engineer con experiencia en entornos AWS. El candidato ideal debe poseer habilidades en Python y Apache Airflow, además de tener un nivel de inglés B2-C1. Se ofrece teletrabajo flexible, horario adaptable y un presupuesto para formación anual. La compañía promueve el desarrollo continuo y...
-
Data Engineer
hace 7 días
Madrid, España Infortec Consultores A tiempo completo**Descripción**: Buscamos Data Engineer (con superpoderes en Python y SQL) ¿Te apasionan los datos más que el café de las 8? ¿Sabes lo que es un DWH sin tener que googlearlo? Entonces sigue leyendo. Lo que necesitas traer: - Experiência real (no solo en proyectos personales) con Python y SQL. - Experiência de 3 años como Data Engineer - Manejo de...
-
Data Engineer
hace 2 días
Madrid, España Grupo Digital A tiempo completo**Descripción**: Desde Grupo Digital, buscamos perfiles de **Data Engineer **para importante proyecto estable. **Localización**:España **Modalidad**: 100% remoto **Horario**: 9h-18h. Verano jornada intensiva: 8h-15h **Perfil y Funciones**: - Trabajarás definiendo la ETL en CLoud (AWS, Python, SnowFlake, Tableau) - Trabajará con el equipo de...
