Big Data Engineer

hace 2 semanas

Madrid, Madrid, España Gaming Innovation Group A tiempo completo

Department:
Technology

Location:
Madrid

Description
As part of GiG's growth strategy, we are establishing a dedicated Migrations Team to lead

the migration of brands from legacy systems and other platforms into our modern GiG

CoreX platform. In the role of Migration Engineer, you will take ownership of the technical

execution of these migrations: designing, implementing, validating, and executing complex

data pipelines to transfer and transform customer and operational data. You will maintain

high standards of data integrity, perform rigorous testing and verification, provide support

throughout cutover phases, and partner closely with stakeholders (product, infrastructure,

operations, compliance) to ensure successful onboarding of clients onto CoreX.

Key Responsibilities

  • Data Pipeline Design & Implementation: Design, develop, and maintain robust

data pipelines for the extraction, transformation, and loading (ETL) of large

volumes of structured and unstructured data, ensuring scalability and efficiency.
- Migration Execution & Validation: Lead the execution of data migrations, including

data extraction, transformation, schema mapping, validation, and cutover,

ensuring data integrity and consistency.
- Collaboration & Stakeholder Engagement: Work closely with product,

technology, delivery, and compliance teams to gather migration requirements,

align on data definitions, and ensure successful migration outcomes.
- Automation & Optimization: Implement automation solutions for ETL/migration

processes to improve efficiency and reduce manual intervention.
- Monitoring & Troubleshooting: Monitor and troubleshoot migration pipelines,

addressing issues promptly to ensure smooth operations.
- Documentation & Process Improvement: Document migration processes,

contribute to process improvement initiatives, and ensure adherence to best

practices.
- Technical Support & Incident Resolution: Provide technical support during

incident resolution related to migration pipelines and data discrepancies.
- Agile Participation: Actively participate in all agile scrum meetings such as daily

standups, refinement sessions, and retrospectives.
- Innovation & Continuous Improvement: Propose and implement new ideas to

improve existing products and services, fostering a culture of innovation.
- Code Review & Mentorship: Perform code reviews for other engineers, ensuring

code quality and knowledge sharing within the team.
- Stakeholder Communication: Effectively communicate with respective

stakeholders, ensuring that all information is transmitted correctly and to the right

audience.

Requirements
Essential Skills

  • Bachelor's/Master's in Computer Science, Engineering, or related field.
  • 3+ years of experience in data engineering, ETL processes, or data migration.
  • Strong SQL skills and experience working with structured and unstructured datasets.
  • Knowledge of data governance, compliance, and data quality assurance.
  • Solution-oriented mindset with the ability to troubleshoot and resolve issues.
  • Strong experience with Big Data and streaming technologies including ClickHouse, Kafka and NiFi
  • Strong knowledge of Microservices, APIs, GraphQL

Preferred Skills

  • Experience in the iGaming industry or regulated markets.
  • Experience with automation of ETL/migration processes.

Benefits

  • Great career development opportunities
  • Hybrid working model
  • International Health Insurance
  • Health and Wellbeing Package (350 EUR per year)
  • Birthday Day Off
  • Me Time - 1 day off per year

  • Big Data Engineer

    hace 2 semanas

    Madrid, Madrid, España Winning A tiempo completo

    At Winning Consulting, we are on the lookout for a Big Data Engineer to be part of our dynamic team. This role involves working on an exciting project for one of our key clients in the banking sector in Madrid (Hybrid).Responsabilities:Designing, developing and optimizing of data pipelines using SQL and Databricks.Implementing of data ingestion and...

  • Big Data Engineer Azure Databricks

    hace 2 semanas

    Madrid, Madrid, España Hays A tiempo completo

    Buscamos Big Data Engineer con Databricks + MLOps¿Qué buscamos?Un perfil técnico Data Engineer con 2-3 años de experiencia para reforzar el equipo de Analítica Avanzada - MLOps.Tareas:• Evolutivo y mantenimiento de pipelines de datos en entornos cloud (Databricks / Azure).• Conocimiento del flujo de procesos ETL.• Integración de modelos de...

  • Desarrollador Senior Big Data

    hace 7 días

    Madrid, Madrid, España Grupo TECDATA Engineering A tiempo completo

    Desarrollador Senior Big Data – Reporting RegulatorioUbicación: 100% RemotoRequisitos Imprescindibles+4 años en PySpark (Spark SQL, DataFrames; Spark Streaming valorado).Nivel medio-alto en Scala.Experiencia en Azure Databricks (Unity Catalog, Delta Lake, workflows, job clusters).Orquestación con Azure Data Factory o similares (Autosys,...

  • Data Engineer

    hace 2 semanas

    Madrid, Madrid, España UST A tiempo completo

    Role DescriptionSeguimos buscando talento…y nos encantaría que te unieras a nuestro equipoPara que nos conozcas algo mejor, UST es una multinacional norteamericana certificada como Top Employer y Great Place to Work con más de empleados a nivel global y con presencia en más de 35 países. Somos líderes en servicios de tecnología digital y...

  • Big Data Architect

    hace 1 semana

    Madrid, Madrid, España Movilges A tiempo completo

    We are recruiting a Big Data Architect to strengthen our team in Madrid with on-site work.What we are looking for:Bachelors or masters degree in Computer Science or similar areas (preferred);5 years (minimum) of experience in Big Data implementation projects;Experience in design of Big Data and Data analytics solutions and Cognitive delivery...

  • arquitecto big data

    hace 2 semanas

    Madrid, Madrid, España IRIUM - Spain A tiempo completo

    En IRIUM nos preocupamos porque no dejes de perseguir tus sueños. Prepárate para conquistar tus metas, y ten siempre presente disfrutar del camino.Estamos buscando a un Arquitecto Big Data para proyecto estable.¿Qué buscamos?:*Solo candidatos que residan en España.Conocimientos y experiencia en:Arquitectura Big Data con diferentes herramientas y...

  • Big Data Architect

    hace 4 días

    Madrid, Madrid, España Solera Holdings, LLC. A tiempo completo

    Position Purpose:We are seeking a highly skilled and experienced Big Data Architect to join our international team. You will play a pivotal role in shaping our Big Data environments and projects, including the Global Data Lake, while enhancing our Sustainable Estimatics offerings. Sustainable Estimatics is a leading suite within the company, recognized for...

  • Big Data Developer

    hace 2 semanas

    Madrid, Madrid, España Axiom Software Solutions Limited A tiempo completo

    Position: Big Data DeveloperLocation: Remote 100%Duration: Long Term B2B COntractJob Description:Requirements:-Advanced knowledge of SQL statements- Experience in data model design- Experience in performing thorough technical/functional testing and data validation- Experience in technological projects in the banking sector- Medium/high level of...

  • Desarrollador Big Data

    hace 2 semanas

    Madrid, Madrid, España Vermont Solutions A tiempo completo

    Hola ¿Eres un crack del backend y te apasiona el mundo Big Data? Entonces Vermont Solutions te está buscandoBuscamos un perfil profesional con2-3 años de experiencia,para trabajar100% en remoto.Tu desarrollo principal debe estar orientado aBig Data, con una sólida base enJava, para integrarte en un equipo dinámico orientado a lagestión y orquestación...

  • Ingeniero/a Big Data

    hace 2 semanas

    Madrid, Madrid, España IRIUM - Spain A tiempo completo 45.000 € - 47.000 €

    En IRIUM nos preocupamos porque no dejes de perseguir tus sueños. Prepárate para conquistar tus metas, y ten siempre presente disfrutar del camino.Actualmente nos encontramos en búsqueda de un perfil INGENIERO/A BIG DATA con al menos 3 años de experiencia en puestos similares para un proyecto estable y con posibilidades de crecimiento en el sector...