Databricks Data Engineer

Hace 2 días

Madrid, España Square One Resources Jornada completa

I'm currently recruiting for a Databricks Data Engineer to join a data-focused team in Madrid.

This is a hands‑on engineering role for someone with strong experience in Databricks, PySpark and Python , who can independently design, build and optimise scalable data pipelines.

Key Responsibilities

  • Design and develop end-to-end data pipelines from source systems through to Gold-layer datasets
  • Build scalable data processing solutions using Databricks and PySpark
  • Implement data ingestion from multiple sources, including APIs, databases and files
  • Work with Medallion Architecture - Bronze, Silver and Gold layers
  • Perform data transformation using PySpark and SQL
  • Process and manage large-scale datasets
  • Optimise pipeline performance and Databricks workloads
  • Ensure data quality, reliability and maintainability

Required Skills

  • Strong hands‑on experience with Databricks
  • Advanced PySpark development
  • Strong SQL and data transformation experience
  • Experience with data ingestion from APIs, databases, files and other sources
  • Experience implementing Medallion Architecture
  • Strong understanding of pipeline performance and optimisation
  • Strong spoken and written English and Spanish language skills
  • Hybrid working environment in Madrid
  • Availability to attend the Madrid office on specific days and for important collaborative meetings