Lead Data Software Engineer

Hace 2 días

Madrid, España EPAM Systems Jornada completa
What makes a number trustworthy enough to drive decisions across an enterprise? The Senior Data Software Engineer (Databricks) role in Malaga sits at the intersection of data engineering and analytics, where robust pipelines support seamless integration and actionable insights for multiple business units. Working closely with a team of data engineers and software developers, you shape the flow of information that powers business strategy. The challenge is to build infrastructure that adapts as business needs evolve. The person in this role decides how data becomes a reliable asset for the company.
Responsibilities Architect and implement scalable data pipelines to support diverse data ingestion and transformation needsCollaborate with software engineering teams to ensure smooth integration of data workflows into broader systemsEngage regularly with project managers to align pipeline development with project timelines and objectivesDevelop, test, and maintain Python-based data workflows within the Databricks platformMonitor pipeline performance and troubleshoot data processing issues to maintain data quality and reliabilityShare data insights and pipeline status updates with business stakeholders to inform decision-makingParticipate in planning sessions to design future-proof data infrastructure and integration strategiesRequirements Proficient in designing and optimizing scalable data workflows using Databricks and PythonSkilled in resolving complex data integration challenges across heterogeneous data sourcesExperienced in collaborating with cross-functional teams including software engineers and project managersCapable of translating business requirements into technical data solutions and pipeline architecturesAdept at analysing data to extract meaningful insights and communicating findings to stakeholders