Empleos actuales relacionados con Data Collection Engineer - Madrid, Madrid - CENTRIC SOFTWARE INC
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Dyrdek Machine, Llc A tiempo completoAbout Dyrdek Machine, LlcDyrdek Machine, Llc is a leading business travel solutions provider that has evolved into a cutting-edge development and design studio. We specialize in creating innovative travel solutions for large corporations, with a sole focus on enhancing the business travel experience for everyone.About the OpportunityWe are seeking a seasoned...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Dyrdek Machine, Llc A tiempo completoAbout Dyrdek Machine, LlcDyrdek Machine, Llc is a leading business travel solutions provider that has evolved into a cutting-edge development and design studio. We specialize in creating innovative travel solutions for large corporations, with a sole focus on enhancing the business travel experience for everyone.About the OpportunityWe are seeking a seasoned...
-
Senior Data Engineer
hace 1 semana
Madrid, Madrid, España Enverus A tiempo completoAbout UsEnverus is a leading provider of industry-leading solutions for the energy industry. We are seeking a highly skilled Senior Data Engineer to join our team.Job SummaryWe are looking for a talented individual to help us formalize our current data analytics capabilities, create new metrics, and design new data collection methods. The ideal candidate...
-
Senior Data Engineer
hace 1 semana
Madrid, Madrid, España Enverus A tiempo completoAbout UsEnverus is a leading provider of industry-leading solutions for the energy industry. We are seeking a highly skilled Senior Data Engineer to join our team.Job SummaryWe are looking for a talented individual to help us formalize our current data analytics capabilities, create new metrics, and design new data collection methods. The ideal candidate...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Dyrdek Machine, LLC A tiempo completoAbout Dyrdek Machine, LLCDyrdek Machine, LLC is a leading business travel startup that has evolved into an agile development and design studio. We specialize in building innovative travel solutions used by large corporations to enhance their business travel experiences.Job SummaryWe are seeking a seasoned Data Engineer with a passion for travel and a track...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Dyrdek Machine, LLC A tiempo completoAbout Dyrdek Machine, LLCDyrdek Machine, LLC is a leading business travel startup that has evolved into an agile development and design studio. We specialize in building innovative travel solutions used by large corporations to enhance their business travel experiences.Job SummaryWe are seeking a seasoned Data Engineer with a passion for travel and a track...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Dyrdek Machine, Llc A tiempo completoAbout Dyrdek Machine, LlcDyrdek Machine, Llc is a leading business travel startup that has evolved into a cutting-edge development and design studio. We specialize in building innovative travel solutions for large corporations, with a mission to make business travel better for everyone.About the RoleWe are seeking a seasoned Data Engineer with a passion for...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Dyrdek Machine, Llc A tiempo completoAbout Dyrdek Machine, LlcDyrdek Machine, Llc is a leading business travel startup that has evolved into a cutting-edge development and design studio. We specialize in building innovative travel solutions for large corporations, with a mission to make business travel better for everyone.About the RoleWe are seeking a seasoned Data Engineer with a passion for...
-
Data Engineer
hace 12 horas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 16 horas
Madrid, Madrid, España HT Recruit Career Page A tiempo completoJob Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at HT Recruit Career Page. As a Data Engineer, you will play a key role in designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data ingestion and transformation pipelines using Azure Data Factory, Synapse Analytics, and...
-
Data Engineer
hace 3 días
Madrid, Madrid, España TEKsystems A tiempo completoAbout the Role:We are seeking a highly skilled Data Engineer to join our team at TEKsystems. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Python, SQL, and PySparkDevelop and maintain data warehouses using Azure Cloud (Data Factory,...
-
Data Engineer
hace 3 días
Madrid, Madrid, España TEKsystems A tiempo completoAbout the Role:We are seeking a highly skilled Data Engineer to join our team at TEKsystems. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Python, SQL, and PySparkDevelop and maintain data warehouses using Azure Cloud (Data Factory,...
-
Senior Data Engineer
hace 2 semanas
Madrid Centro, Madrid, España Enverus A tiempo completoJob SummaryWe are seeking a highly skilled Senior Analytics Engineer to join our team at Enverus. As a Senior Analytics Engineer, you will play a key role in helping us improve our analytics capabilities and drive business growth.About the RoleThe ideal candidate will have a strong background in data analytics, statistics, and project management. You will be...
-
Senior Data Engineer
hace 2 semanas
Madrid Centro, Madrid, España Enverus A tiempo completoJob SummaryWe are seeking a highly skilled Senior Analytics Engineer to join our team at Enverus. As a Senior Analytics Engineer, you will play a key role in helping us improve our analytics capabilities and drive business growth.About the RoleThe ideal candidate will have a strong background in data analytics, statistics, and project management. You will be...
-
Data Scientist
hace 2 semanas
Madrid, Madrid, España Studentuniverse A tiempo completoAbout StudentuniverseStudentuniverse is a leading provider of travel solutions for students and young adults. Our mission is to make travel more accessible and affordable for this demographic.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing and implementing advanced...
-
Data Scientist
hace 2 semanas
Madrid, Madrid, España Studentuniverse A tiempo completoAbout StudentuniverseStudentuniverse is a leading provider of travel solutions for students and young adults. Our mission is to make travel more accessible and affordable for this demographic.Job SummaryWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing and implementing advanced...
-
Data Engineer
hace 4 días
Madrid, Madrid, España Inetum Spain A tiempo completo{"title": "Data Engineer Role", "description": "About the RoleWe are seeking a skilled Data Engineer to join our team at Inetum Spain. As a Data Engineer, you will be responsible for developing and maintaining new big data platforms and data products.Key ResponsibilitiesDesign and implement data pipelines that ingest, transform, and prepare data from various...
-
Data Engineer
hace 5 días
Madrid, Madrid, España Inetum Spain A tiempo completo{"title": "Data Engineer Role", "description": "About the RoleWe are seeking a skilled Data Engineer to join our team at Inetum Spain. As a Data Engineer, you will be responsible for developing and maintaining new big data platforms and data products.Key ResponsibilitiesDesign and implement data pipelines that ingest, transform, and prepare data from various...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Fever España A tiempo completoAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Fever España. As a Data Engineer, you will play a critical role in building and operating the core technologies that enable data scientists, analysts, and business units to leverage rich data in efficient and innovative ways to generate impact and connect people to the most...
-
Data Engineer
hace 2 semanas
Madrid, Madrid, España Fever España A tiempo completoAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at Fever España. As a Data Engineer, you will play a critical role in building and operating the core technologies that enable data scientists, analysts, and business units to leverage rich data in efficient and innovative ways to generate impact and connect people to the most...
Data Collection Engineer
hace 3 meses
Centric Pricing (formerly StyleSage), is an AI driven competitive assortment benchmarking and market trend insights solution for fashion, beauty and home goods brands and retailers.
We are a key innovation partner for iconic and emerging brands across the world.Our Platform is able to analyze the info of more than 1.000 retailers, processing data from more than brands, tracking millions of products
The Challenge:
You will be part of the Data Collection Team, formed by a group of motivated individuals that focus on crawling services.
This team is the origin and fuel of our pipeline, thus needing to guarantee data is extracted in a reliable, sustainable and homologated way.
As Data Collection Engineer, your main mission is to deliver software systems focused on fast high-level web crawling by using Python web scraping frameworks, designing, developing, automating and evolving tools for crawling at scale.
Responsibilities:
- Collaborate with the rest of the technical team to ensure the Data-Collection solutions align with the organization's goals, as well as customer needs.
- Build internal solutions used to crawl websites and extract structured data from their pages.
- Work around bot protections, analyzing patterns, state of the art and generating cutting edge alternatives.
- Review software code written by other team members to identify bugs and improve the code quality.
- Remain current on technology trends to keep our software as innovative as possible.
Desired Technical Skills:
- 5+ years of experience working as a software engineer
- Relevant experience implementing software in Python. Django knowledge is a plus
- Experience using scraping frameworks. It would be great if you have knowledge with Scrapy.
- Knowledge and agility working on low level TCP/IP protocols (TLS, HTTP(S), SSL, etc)
- High knowledge of the Web environment (model, standards, DOM, Request-Response, Cookies, Javascript, Browsers, Headers, XHR, etc.).
- Building well documented and organized systems, following common coding conventions.
- Strong troubleshooting and debugging skills.
- Experience in Continuous Integration/Continuous Deployment (CI/CD) and related tooling.
- Familiarity with cloud platforms like AWS, GCP, or Azure. Experience with Docker is a plus.
- Experience with UNIX systems and scripting.
- SQL and some database administration knowledge.
- Git, as it is the version control system our whole company uses and it's deeply integrated with our development process.
Soft Skills
- Your job will require written and spoken communications in English.
- Collaborative skills and teamwork mindset. We work with people from different countries and timezones.
- Ability to work autonomously. We will be there to unblock you and help you with all your tasks at any time, but we expect you to do the heavy lifting by yourself.
- Analytic orientation, able to decompose complex problems and projects into manageable pieces; comfortably suggesting and presenting solutions.
Centric Software provides equal employment opportunities to all qualified applicants without regard to race, sex, sexual orientation, gender identity, national origin, color, age, religion, protected veteran or disability status or genetic information.
