Senior Data Engineer

Hace 12 horas

Madrid, España Emburse Jornada completa

Who We Are:At Emburse, you'll not just imagine the future – you'll build it.
As a leader in expense intelligence, we are creating a future where technology drives business value and inspires extraordinary results.
Our AI-powered platform helps organizations modernize financial operations, increase visibility, and optimize spend across the enterprise.
What you will Do Software Engineering Architects, deploys, and maintains production-grade Python microservices, serverless components (AWS Lambda), batch workers, web services, and shared core libraries across the analytics ecosystemEngineers RESTful interfaces and application integrations to expose dataset capabilities to platform applications, encompassing secure object storage exchange, query orchestration, automated report delivery, and embedded analytics infrastructureConstructs backend infrastructure powering AI analytics solutions, incorporating LLM and natural language query translation engines like Snowflake Cortex, controlling dialog state, guaranteeing multi-tenant data isolation before execution, and optimizing throughput and resource utilizationAuthors clean, resilient codebase backed by comprehensive test suites while directing Git Hub Actions continuous integration and continuous deployment pipelines for automated compilation, verification, security inspection, and production releasesSafeguards system configuration and secrets using key-pair authentication, parameter management, and service credentials while proactively updating software dependencies based on vulnerability scanning metrics Data Engineering Constructs and manages ingestion and transformation workflows utilizing Airflow, AWS Glue, Spark, and Snowflake dynamic tables to feed multi-tier lakehouse environments from diverse sourcesEngineers automated data cleansing and enrichment routines integrating machine learning models and record reconciliation methods, while safely executing massive historical data re-processingArchitects robust multi-tenant security frameworks in Snowflake employing row-level policies, secure functions, and isolated access controls across global cloud infrastructure regionsImplements metadata-driven automation to dynamically generate client?specific semantic layers from templates, incorporating state tracking, automated recovery, and version rollbacksExecutes data governance protocols and privacy compliance workflows, including systematic tenant data purging across all analytical storage tiersDevelops internal platform analytics modules to track, aggregate, and report infrastructure consumption and operational expenditures across cloud vendor ecosystemsEstablishes proactive telemetry and alerting, drives resolution for system incidents, conducts thorough root?cause investigations, and deploys long-term technical remediation Process Follows SDLC processes, including adopting agile-based processes, peer code-reviews, and technical preparations required for scheduled releases and demos.
Partners with product, analytics and data science team to drive requirements that take into account all parties' needsEstablishes monitoring, responds to alerts and resolves issues within data pipelinesUses and helps shape AI-assisted development practices and tooling for the team.
Impact Executes intricate, multi-faceted capabilities spanning microservices, automated workflows, and analytical storage infrastructure with high autonomy while providing technical leadership across mid-scale initiativesAssumes direct accountability for the reliability, security architecture, and long-term viability of deployed systems while systematically uncovering technical remediation opportunitiesPinpoints architectural risks across peer technical deliverables and formulates pragmatic, alternative implementation strategiesStreamlines operational processes, resolves critical system defects, performs advanced codebase refactoring, and exhibits expert troubleshooting capabilities across application code, cloud infrastructure, and analytical queriesAuthors comprehensive technical documentation, operational runbooks, and detailed data dictionaries to support platform capabilitiesDrives system architecture discussions and fulfills expanded peer code review obligations across the engineering organizationSpearheads onboarding initiatives and provides technical coaching and mentorship to junior staff members What you will bringExperience: Demonstrated background of at least six years architecting enterprise software solutions and big data platforms in operational environments.
Required: Bachelor's degree in Computer Science or related field, or equivalent years' experienceAdvanced proficiency in Python engineering, spanning distributed microservices, internal modules, RESTful interface design, unit testing frameworks, and Git Hub Actions release pipelines rather than ad?hoc scripting.
Expert SQL query optimization, data modeling techniques, and extensive background delivering cloud warehouse archi