Senior Web Scraper | BeautifulSoup or Scrapy

Hace 2 días

Barcelona, Barcelonés (comarca); Provincia de Barcelona; Cataluña, España NielsenIQ Jornada completa

Overview

As Senior Python Developer in our scraping team, you will optimize data collection by building robust Scrapy spiders and ensuring resilient crawlers against website changes. You will uphold code and data quality through reviews and validation, and design sophisticated crawling solutions that navigate anti-bot measures. You'll contribute to major builds across codebases, documenting clearly and sharing knowledge with relevant teams. This role sits in a fast-growing, start-up–spirited NIQ for Digital Commerce, focused on real-time retail insights.

Compensaciones / Beneficios Flexible working environment
Volunteer time off
LinkedIn Learning
Employee-Assistance-Program (EAP)

Responsabilidades Design, implement and document robust Scrapy spiders
Perform code reviews and data validation to ensure quality
Develop web crawling solutions that bypass advanced anti-bot measures
Architect new features across multiple codebases with clear documentation
Provide training and knowledge sharing to relevant teams

Requisitos principales Masters degree in Computer Science, IT, or related field
At least 3 years of professional software engineering experience
Knowledge of BeautifulSoup or Scrapy
Familiarity with HTML and JavaScript, understanding of single-page applications
Experience with RESTful and/or GraphQL APIs
Hands-on experience with Django, FastAPI, or similar Python web frameworks
Knowledge of Scrapy is a plus
Experience with time series databases (InfluxDB) is advantageous
Strong skills in Docker, Git, pandas, regular expressions, Linux, and bash scripting
Experience with AWS, GCP, or Azure
Enthusiastic, motivated, autonomous; enjoys tackling challenging software problems
Passionate about tech and continuous learning
enthusiastic
autonomous
mentally-stimulating problem solving
BeautifulSoup
Scrapy
HTML/JavaScript for SPAs