Data Engineer PySpark – AWS

hace 5 días

Greater Barcelona Metropolitan Area, España Grupo TECDATA Engineering A tiempo completo

Funciones y responsabilidades

Desarrollo y mantenimiento de pipelines de datos en PySpark en entornos cloud.

Implementación de procesos ETL/ELT sobre AWS.

Procesamiento de grandes volúmenes de datos en arquitecturas Big Data.

Integración de datos desde diferentes fuentes (S3, bases de datos, servicios internos).

Uso De Servicios AWS Como
S3 para almacenamiento

Glue / EMR para procesamiento

Athena y/o Redshift para consulta y explotación

Desarrollo de scripts en Python para automatización y soporte de procesos.

Optimización del rendimiento de jobs Spark.

Validación, limpieza y control de calidad del dato.

Monitorización de procesos batch y resolución de incidencias.

Uso de SQL para análisis y verificación de datos.

Versionado de código con Git.

Documentación técnica de los desarrollos.

Trabajo colaborativo con equipos de Data, Analytics y Negocio.

  • Senior PySpark Data Engineer

    hace 2 semanas

    Barcelona, España Axiom Software Solutions Limited A tiempo completo

    A software solutions provider based in Barcelona seeks a skilled Data Engineer to design and optimize large-scale data processing systems. Ideal candidates will have a solid background in PySpark and extensive experience with AWS services like Athena and EMR. This role requires strong problem-solving abilities and communication skills. Join this dynamic...

  • Data Engineer

    hace 2 días

    Greater Barcelona Metropolitan Area, España TST Group A tiempo completo

    Mission:A Data Engineer is responsible for designing, building, and maintaining large-scale data systems that enable data-driven decision-making.They work with various stakeholders to understand data requirements, data architectures, and implement data pipelines to support business intelligence, analytics, and data science initiatives.Job Related...

  • Data Engineer Aws

    hace 2 semanas

    Barcelona, España Innovating 2Gether A tiempo completo

    **¿Qué buscamos?**: Te buscamos a ti, si eres un/a Data Engineer AWS con una experiência mínima de 2 años, para trabajar para una importante empresa IT. ¿Encaja con tu trayectoria y expectativas profesionales? ¡Estamos deseando conocerte! Trabajamos con las mejores empresas de nuestro sector. Como Data Engineer AWS tus **responsabilidades **van a...

  • Data Engineer

    hace 2 semanas

    Barcelona, España OnHires A tiempo completo

    Descripción del trabajoRemote | Full-time | SaaS | Data EngineeringOnHires is partnering with Instantly.ai, a high-growth AI-driven sales outreach and lead intelligence platform used by over 35,000 B2B companies worldwide. We are looking for a Data Engineer to take ownership of SuperSearch — the backend infrastructure powering B2B lead discovery and...

  • Data Engineer, hibrido

    hace 1 semana

    Barcelona, España Axiom Software Solutions A tiempo completo

    Data EngineerSeeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation. Key Responsibilities: Data...

  • Data Engineer

    hace 1 semana

    Barcelona, Barcelona, España Axiom Software Solutions Limited A tiempo completo

    Job Title: Data EngineerJob Description:Seeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and...

  • Lead Data Engineer

    hace 5 días

    Greater Barcelona Metropolitan Area, España Oxigent Technologies A tiempo completo

    ¿Te interesaría seguir desarrollándote comoLead Data Engineeren unamultinacionalque realiza soluciones defidelización y customer engagement para el sector retail, trabajando en un entorno altamente colaborativo, con tecnología puntera, arquitectura moderna y formando parte de un equipo técnico de primer nivel?Desde Oxigent Technologies seleccionamos...

  • Data Engineer

    hace 5 días

    Barcelona, España Axiom Software Solutions Limited A tiempo completo

    OverviewJob Title: Data EngineerJob Description: Seeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and...

  • Data Engineer

    hace 2 semanas

    Barcelona, España Axiom Software Solutions Limited A tiempo completo

    Job TitleData EngineerJob DescriptionSeeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation.Key...

  • Senior Cloud Engineer AWS

    hace 2 semanas

    Greater Barcelona Metropolitan Area, España Experis España A tiempo completo

    Senior Cloud Engineer (AWS) – Barcelona / Hybrid (3 days remote)We're looking for a highly skilledSenior Cloud Engineerwith deep AWS expertise to join a big international technology organization.Responsibilities:Design, implement, and manage a multi-account AWS Landing Zone and foundational cloud services.Support complex application migrations to AWS...