Senior Data Engineer

Hace 1 día

barcelona, cataluña, España Cofco International Jornada completa

Select how often (in days) to receive an alert:

Barcelona, Barcelona, ES

COFCO International is a global agri-business with a clear vision, strong values and a positive culture, focused on being a leader in the global grains, oilseeds and sugar supply chains. We provide the food the world needs in a responsible way. Headquartered in Geneva, Switzerland, we are ambitious, with the right structures and culture to meet the world's increasing and changing needs. With 12,000+ people in 35 countries, our global portfolio includes assets across the Americas, Europe, Africa, Middle East, and Asia-Pacific. We trade with over 50 nations, while providing farmers unique direct access to the growing Chinese market.

JOB PURPOSE:

Provide hands-on expertise in designing, delivering and supporting reliable, secure, scalable and cost-conscious data solutions across COFCO International as a senior/specialist contributor within the Data Engineering team.

Take technical ownership of assigned data pipelines, integrations and data models, including the enterprise data-lake ecosystem and other business data solutions. Guide ingestion, transformation, storage and consumption of data for analytics, reporting and downstream applications.

Combine architecture, coding and troubleshooting with technical mentoring and coordination of assigned work. May lead engineers or external contributors on specific technical initiatives without holding a formal team-leader position. Work with business analysts, data product owners, project managers, Architecture, Data Governance, Security and Operations to translate requirements into maintainable solutions and ensure production continuity.

RESPONSIBILITIES:

  • Deliver assigned engineering and support work; contribute to prioritization and estimates, mentor engineers and, where assigned, coordinate contributors on specific technical initiatives. Formal team management and overall capacity allocation remain with the line manager.
  • Translate business and data requirements into technical designs, development estimates and delivery plans; communicate dependencies, risks and decisions early.
  • Design, develop and maintain end-to-end ETL/ELT pipelines and data models across enterprise data-lake and other business data solutions; remain hands-on in coding, reviews and complex troubleshooting.
  • Guide Azure Data Factory and Azure Synapse delivery, including SQL, Spark-based transformations, notebooks and pipeline orchestration; promote reusable patterns and maintainable technical documentation.
  • Deliver integrations between source systems, data platforms and downstream consumers, including secure tabular-data extracts and file transfers; coordinate connectivity and access requirements with infrastructure and security teams.
  • Support analytics and financial-reporting data flows, working with business and application teams to validate extraction logic, reporting periods, reconciliations and downstream data consistency.
  • Take technical ownership of production support for assigned solutions: maintain monitoring, review alerts, investigate incidents, elevate promptly and deliver root-cause analysis and permanent corrective actions against agreed service levels; coordinate incident resolution where assigned.
  • Implement agreed data-quality rules, validation and technical remediation in pipelines and catalogs, working with Data Governance, data product owners and business analysts; maintain clear ownership boundaries for functional data issues.
  • Ensure version control, code reviews, automated testing and controlled CI/CD releases; maintain regression coverage, rollback arrangements, runbooks and production-readiness checks.
  • Improve pipeline stability, scalability, performance and cloud consumption; evaluate load strategies, scheduling and environment usage to avoid unnecessary processing and cost.
  • Plan technical modernization and runtime upgrades with Architecture and Operations; assess compatibility, security and operational impacts before deployment.
  • Contribute to knowledge transfer, support coverage and technical documentation to reduce reliance on individuals; report delivery, service and capacity risks to the line manager.

REQUIREMENTS:

  • Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent relevant professional experience.
  • Relevant Azure or data-engineering certifications are desirable.
  • 10+ years of hands‑on experience designing, delivering, and supporting enterprise data‑engineering solutions, including experience in Microsoft Azure.
  • Experience providing technical guidance to data engineers, including mentoring, code reviews and collaboration with external service providers; experience coordinating delivery for