Lead Data Scraping Engineer

hace 7 meses


En remoto, España Datalogics A tiempo completo

**Lead Data Scraping Engineer**
- **Salary up to 9500 EUR per month**:

- **100% remote work (1 meeting per month in Portugal)**:

- **Full time**:

- **Contract: CoE/EOR/B2B**

Our client, with headquarters in the EU, specializes in providing highly accessible and carefully curated data covering a wide range of products. With enormous amounts of retail data at their disposal, they are addressing the challenges faced by retailers and suppliers by collecting, structuring, and refining data, making it more convenient for their customers to analyze.

**Requirements**:

- 5+ years of experience in large-scale web scraping utilizing JavaScript, Node.js, Puppeteer and Playwright
- 2-3+ years of modern Python experience, focusing on data wrangling/ equivalent experience using SQL
- Professional experience in reverse engineering Android apps and their APIs.
- Deep knowledge of how modern websites work and are built
- Advanced knowledge of TCP/IP, TLS, HTTP/2, QUIC, DNS, WAF, web browser internals, OAuth flows, networking and security principles,
- Hands-on experience with MITM traffic interception
- Seasoned knowledge and strong experience bypassing leading anti-bot systems (Cloudflare, Imperva, Akamai)
- 3+ years of senior-level SRE/DevSecOps or similar experience, ideally on AWS

**A huge plus**:

- Experience working with Kubernetes, infrastructure as code and GitOps
- Excellent verbal and written English skills

**Responsibilities**:

- Design, build, and evolve sophisticated systems that scrape data reliably and cost-effectively at scale, overcoming any challenges in your way.
- Take ownership of our web scraping platform's future technical direction and evolution. This is a core part of our business, driving innovation and operational efficiency.
- Work closely with our principal engineers, data scientists, data analysts, project managers and sales teams, fostering a collaborative environment that bridges technical and business perspectives to drive success.

**Benefits**:

- Flexible working hours
- Health benefits (only with CoE)
- Travel expenses are fully covered

Pay: 7,500.00€ - 9,500.00€ per month

Work Location: Remote


  • Functional Data Lead

    hace 6 meses


    En remoto, España Red Commerce A tiempo completo

    **Functional Data Lead** RED is currently looking for a Functional Lead for our long-standing end customer. Title: Functional Data Lead Start: ASAP Duration: 6 months contract + possible extension Location: remote with occasional travelling Language: English **Requirements**: Proven experience in clinical data migration, within the pharmaceutical or...

  • Fuctional Data Lead

    hace 6 meses


    En remoto, España Red Commerce A tiempo completo

    RED is currently looking for a **Functional Data Lead** for our long-standing end customer. **Title**: Functional Data Lead **Start**: ASAP **Duration**: 6 months contract + possible extension **Location**: remote with occasional travelling **Language**: English **Key Responsibilities**: - Preparation of business cases and provide support for the...

  • Data Engineer

    hace 7 meses


    En remoto, España Roadsurfer A tiempo completo

    **Why roadsurfer?** - ** TEAM SPIRIT & TEAM EVENTS**: Look forward to a collegial atmosphere with flat hierarchies, lots of fun and great team spirit, as well as regular team events such as joint sports sessions, pizza & beer evenings, etc. - ** FLEX WORK & WORKATION**: You are flexible in terms of working hours. Our Flex Work Policy enables you to work from...

  • Data Engineer

    hace 7 meses


    En remoto, España Omega CRM A tiempo completo

    **Omega CRM Consulting is looking for a Data Engineer** **that would like to collaborate with one of the top global pharmaceutical companies.** We're currently seeking a talented Data Engineer to join a newly formed Product Team. In this role, you'll have the opportunity to scale up and globally rollout our Customer Data Platform (CDP), a key solution used...

  • Data Ops Engineer

    hace 6 meses


    En remoto, España Red Commerce A tiempo completo

    **Data OPs Engineer / Remote from EU / 8 months / Start ASAP** **Project description**: We are looking for a detail-oriented Data Integration Engineer with expertise in Amazon Redshift and EXASOL. This role demands sound knowledge of AWS landscape and responsibilities would include performing migration activities during pilot phase, developing reusable...


  • En remoto, España Tangelo Games A tiempo completo

    For over a decade, Tangelo Games has been dedicated to making a positive impact on people's lives, and our passion drives us to continue this mission. As a collective of enthusiastic gamers and developers, we don't just craft games; we forge connections. Whether through our vibrant multiplayer gaming community, 'Mundigames,' or our company ethos that...

  • Data Engineer

    hace 7 meses


    En remoto, España ISCAREM HUMAN RESOURCES A tiempo completo

    Nuestro cliente es una empresa 100% tecnológica especilizada en el desarrollo de servicios y productos de transformación digital data-driven para cambiar integralmente o mejorar el procesamiento, calidad, gestión, accesibilidad y forma en que se muestran y trabajan los datos de la empresa. Disponen una gran gama de servicios y productos que abarcan desde...

  • Data Engineer

    hace 6 meses


    En remoto, España HomeBuddy A tiempo completo

    **Are you passionate about developing robust data models and building scalable data pipelines, and got a deep interest in technology? Are you willing to be a part of a quickly growing, product-oriented company while working remotely from home? Then welcome to HomeBuddy!** **This role is full-time and offers home working flexibility** **HomeBuddy** is an...

  • Data Engineer

    hace 6 meses


    En remoto, España Reverse Tech A tiempo completo

    **About Us**: At Reverse Tech, we are on a mission to create, launch, and scale digital product brands in the health and wellness space. Our goal is ambitious - we aim to help 10 million people improve their health by 2026 through hyper-targeted, mass-scale brands. We specialize in subscription-based business models and pride ourselves on being...

  • Data Quality Engineer

    hace 6 meses


    En remoto, España Red Commerce A tiempo completo

    **Data Quality Engineer / Remote in EU / 8 month minimum contract / Start ASAP** **Project description**: - Definition of test plan and test strategy - Execution of data reconciliation verification - Development of migration verification sections of runbook **Requirements**: - Expertise in Amazon Redshift and EXASOL - Strong experience in AWS landscape -...

  • Data Engineer

    hace 6 meses


    En remoto, España Nextail A tiempo completo

    At Nextail, you will be part of a cross-functional and autonomous team where you will build cloud components for the company. **Our team**: You will be part of the Data Platform team. Some of the coworkers from our teams are: Carlos Varela (Senior Architect) Dario Cazás (Architect) David Fernández (Data Engineer) Ana Prior (Software...

  • Data Center Engineer

    hace 6 meses


    En remoto, España Red Commerce A tiempo completo

    Data Center Engineer - Europe - Remote As a pivotal member within our IT infrastructure division, the Data Center Expert will assume responsibility for crafting, executing, and upholding the integrity of our data center environments. **Responsibilities**: - Data Center Design and Strategy: Collaborate with stakeholders to evaluate business requirements...


  • En remoto, España ToBeIT A tiempo completo

    ¡Hola! Desde ToBeIT estamos buscando un Data Engineer Spark/Scala, para trabajar en una de las principales compañías de consultoría tecnológica 100% remoto. **Funciones**: Ingesta y procesamiento de datos con Spark y Scala. **Requisitos obligatorios**: At least 2 years experience working with big data (spark, hadoop, hive, kafka). At least 2 year...

  • Big Data Engineer

    hace 6 meses


    En remoto, España FHIOS A tiempo completo

    En FHIOS estamos buscando un/a Big Data Engineer para unirse al equipo de ingenieria de uno de nuestros clientes líder en el sector automotive y participar en proyectos de Industria 4.0. ¿Quién es FHIOS? Es muy probable que antes de aplicar a la oferta de trabajo te preguntes: ¿FHIOS? ¿Qué es? ¡Conócenos! Somos una consultoría tecnológica que...

  • Data Engineer

    hace 6 meses


    En remoto, España HEMAV Technology A tiempo completo

    At HEMAV we are an AgriTech StartUp founded in 2012 working passionately on Data Science in the agrifood industry with the purpose of generating more food with less environmental impact. ️ We use a unique approach, for yield forecasting based on Artificial Intelligence using satellite technology and other data sources (drone, meteo, soil, etc.). Users of...

  • Junior Data Engineer

    hace 6 meses


    En remoto, España Nextail A tiempo completo

    At Nextail, you will be part of a cross-functional and autonomous team where you will build cloud components for the company. **Our team**: You will be part of the Data Platform team. Some of the coworkers from our teams are: Carlos Varela (Senior Architect) Rosa Ferrando (Senior Software Engineer) Pablo Axeitos (Senior Software...

  • Senior Data Engineer

    hace 6 meses


    En remoto, España Parser Limited A tiempo completo

    This position offers you the opportunity to join a fast-growing technology organisation that is redefining productivity paradigms in the software engineering industry. If you are passionate about technology, this opportunity is for you. As a Data Engineer, you will be part of a centralised data products team with the primary purpose to build a practical and...


  • En remoto, España Semrush A tiempo completo

    Job Description Hi there! We are Semrush, a global IT company developing our own product - a platform for digital marketers. New stars are born here, so don’t miss your chance. This is our \*\*Data Governance Engineer role for those who want to turn ideas into reality and participate in improving Semrush’s analytics tools. Tasks in the role - Help...

  • Data Engineer

    hace 6 meses


    En remoto, España Semrush A tiempo completo

    Hi there! We are Semrush, a global IT company developing our own product - a platform for digital marketers. New stars are born here, so don’t miss your chance. This is our role** Data Engineer** for those who want to turn ideas into reality using code, algorithms, and maybe a bit of magic. **Tasks in the role**: - Together with the Senior Data...

  • Data Engineer

    hace 6 meses


    En remoto, España Semrush A tiempo completo

    Job Description Hi there! We are Semrush, a global IT company developing our own product - a platform for digital marketers. New stars are born here, so don’t miss your chance. This is our role Data Engineer for those who want to turn ideas into reality using code, algorithms, and maybe a bit of magic. Tasks in the role - Together with the Senior Data...