Senior Data Platform Engineer

hace 6 días

Málaga, España EPAM Systems A tiempo completo

Do you have background and wide experience in Data Platform engineering and strong knowledge in Databricks? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as Senior Data Platform Engineer.

At this role, you’ll have the opportunity to work with the latest technologies in data engineering, shape the future of enterprise data infrastructure, and drive impactful innovations across cloud platforms.

RESPONSIBILITIES
- Architect and deploy robust, scalable, and secure data platforms leveraging Databricks and cloud technologies
- Build cloud-agnostic solutions across platforms such as AWS, Azure, and GCP, ensuring flexibility and resilience
- Design end-to-end data pipelines, integrating with data lakes, warehouses, and streaming frameworks
- Utilize the full spectrum of Databricks features
- Collaborate with cross-functional teams to implement and maintain Databricks-based workflows, ensuring best practices are followed
- Develop CI/CD pipelines tailored for data platforms, ensuring seamless deployment and testing
- Implement monitoring, logging, and alerting frameworks for infrastructure health and operational excellence
- Optimize compute and storage resources for cost-efficiency without compromising performance
- Troubleshoot and resolve performance issues related to Databricks and Spark
- Mentor users on best practices for cluster management, job optimization, and resource allocation
- Ensure the platform adheres to compliance standards and meets security requirements
- Identify and implement cost-saving opportunities across the infrastructure
- Drive adoption of advanced Databricks capabilities, such as Photon and Graviton instances, for enhanced efficiency
- Regularly review and improve existing architectures to align with evolving business and technology needs

**REQUIREMENTS**:

- Extensive experience with Databricks, Apache Spark, and distributed data processing
- Strong programming skills in Python, Scala, and SQL for building robust data solutions
- Proficiency in cloud platforms like AWS (S3, IAM, Lambda), Azure, or GCP, with a focus on data engineering services
- Expertise in data architecture principles, including data lakes, lakehouses, and ETL workflows
- Hands-on experience with CI/CD tools and Infrastructure as Code (Terraform, CloudFormation)
- Familiarity with monitoring tools and observability frameworks for large-scale data environments

NICE TO HAVE
- Certifications in Databricks, AWS, Azure, or GCP
- Knowledge of Kubernetes and containerized deployments for data pipelines
- Experience with real-time data streaming frameworks and governance tools

WE OFFER
- Private health insurance
- EPAM Employees Stock Purchase Plan
- 100% paid sick leave
- Referral Program
- Professional certification
- Language courses

  • Senior Data Platform Engineer, Málaga

    hace 2 semanas

    Málaga, España Jordan martorell s.l. A tiempo completo

    Senior Data Platform Engineer Ebury is a leading global fintech company that empowers businesses to trade and grow internationally. It offers a comprehensive suite of products, including international payments and collections, FX risk management, trade finance, and API integrations. Founded in 2009 by Juan Lobato and Salvador García, Ebury is one of the...

  • Senior Data Platform Engineer

    hace 2 días

    Málaga, España Ebury A tiempo completo

    **Senior Data Platform Engineer - Fintech** Join Our Data Team at Ebury. Ebury’s strategic growth plan would not be possible without our **Data team** and we are seeking a **Senior Data Engineer** to join our **Data Platform Engineering team**! Our data mission is to develop and maintain **Ebury’s Data Warehouse** and serve it to the whole company,...

  • Senior Data Platform Engineer

    hace 4 días

    Málaga, España Ebury A tiempo completo

    Ebury is a hyper-growth FinTech firm, named in 2021 as one of the top 15 European Fintechs to work for by AltFi. We offer a range of products including FX risk management, trade finance, currency accounts, international payments and API integration. **Senior Data Platform Engineer - Fintech** **Málaga Office - Hybrid: 4 days in the office, 1 day working...

  • Senior Data Platform Engineer, Málaga

    hace 3 días

    Málaga, España Ebury A tiempo completo

    Senior Data Platform EngineerEbury is a leading global fintech company that empowers businesses to trade and grow internationally. It offers a comprehensive suite of products, including international payments and collections, FX risk management, trade finance, and API integrations. Founded in 2009 by Juan Lobato and Salvador García, Ebury is one of the...

  • Senior Data Lead Engineer: Cloud Data, AI

    hace 16 horas

    Málaga, España Ubique Systems A tiempo completo

    A leading data solutions firm in Málaga is seeking a Senior Data Lead Engineer to drive the transformation of cloud data, AI, and BI for their Global Transaction Banking platforms. This role involves leading the data and AI platform strategy, designing cloud data solutions, and ensuring data quality and governance. Ideal candidates should have 5+ years of...

  • Senior Data Platform Engineer: Build Scalable Pipelines

    hace 17 horas

    málaga, España Jordan martorell s.l. A tiempo completo

    Join a dynamic fintech company as a Senior Data Platform Engineer, where you will play a crucial role in developing and optimizing data platforms. This position offers a chance to work collaboratively with data analysts and engineers to enhance data accessibility and quality. You will be responsible for implementing data governance policies, automating data...

  • Senior Big Data Engineer

    hace 1 semana

    Málaga, España Grid Dynamics A tiempo completo

    Join to apply for the Senior Big Data Engineer role at Grid Dynamics 1 day ago Be among the first 25 applicants Join to apply for the Senior Big Data Engineer role at Grid Dynamics About The ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and...

  • Staff Data Platform Engineer

    hace 2 semanas

    Málaga, España Ebury A tiempo completo

    Ebury is a global fintech firm dedicated to empowering businesses to expand internationally through tailored and forward-thinking financial solutions. Since our founding in 2009, we've grown to a diverse team of over 1,700 professionals across 40+ offices and 29+ markets worldwide. Joining Ebury means becoming part of a collaborative and innovative...

  • Senior Data Engineer

    hace 3 días

    Málaga, España EPAM A tiempo completo

    Senior Data Engineer (Palantir)Do you have a software engineering background and strong knowledge of Palantir Foundry? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Data Engineer. EPAM is shaping the digital future for Fortune 1000 companies, building...

  • Senior Data Engineer

    hace 6 días

    Málaga, España Ultra Tendency A tiempo completo

    Join to apply for the Senior Data Engineer role at Ultra Tendency Our Engineering department is growing, and we're now looking for a Senior Data Engineer - Databricks (m/f/*) to join our team in Spain, supporting our global growth. As Senior Data Engineer (m/f/*), you design and optimize data processing algorithms on a talented, cross‑functional team. You...