Data Engineer Consulting
Hace 2 días
Madrid, Area Metropolitana (comarca); Comunidad de Madrid, España
Square One Resources
Jornada completa
Gratis con email o Google
Guarda esta oferta y sigue tu búsqueda
Crea una cuenta gratis para guardar empleos, crear alertas y volver a esta oferta desde tu panel.
Gratis con email o Google
Al continuar, aceptas nuestros Términos & Política de Privacidad.
I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.
This is a hands?on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.
Key Responsibilities
Design and develop end-to-end data pipelines from source systems through to Gold-layer datasetsBuild scalable data processing solutions using Databricks and PySparkImplement data ingestion from multiple sources, including APIs, databases and filesWork with Medallion Architecture
- Bronze, Silver and Gold layersPerform data transformation using PySpark and SQLProcess and manage large-scale datasetsOptimise pipeline performance and Databricks workloadsEnsure data quality, reliability and maintainabilityRequired Skills Strong hands?on experience with DatabricksAdvanced PySpark developmentStrong SQL and data transformation experienceExperience with data ingestion from APIs, databases, files and other sourcesExperience implementing Medallion ArchitectureStrong understanding of pipeline performance and optimisationStrong spoken and written English and Spanish language skillsHybrid working environment in MadridAvailability to attend the Madrid office on specific days and for important collaborative meetings#J-*-Ljbffr
This is a hands?on engineering role for someone with strong experience in Databricks, PySpark and Python, who can independently design, build and optimise scalable data pipelines.
Key Responsibilities
Design and develop end-to-end data pipelines from source systems through to Gold-layer datasetsBuild scalable data processing solutions using Databricks and PySparkImplement data ingestion from multiple sources, including APIs, databases and filesWork with Medallion Architecture
- Bronze, Silver and Gold layersPerform data transformation using PySpark and SQLProcess and manage large-scale datasetsOptimise pipeline performance and Databricks workloadsEnsure data quality, reliability and maintainabilityRequired Skills Strong hands?on experience with DatabricksAdvanced PySpark developmentStrong SQL and data transformation experienceExperience with data ingestion from APIs, databases, files and other sourcesExperience implementing Medallion ArchitectureStrong understanding of pipeline performance and optimisationStrong spoken and written English and Spanish language skillsHybrid working environment in MadridAvailability to attend the Madrid office on specific days and for important collaborative meetings#J-*-Ljbffr