Senior Data Engineer

hace 4 semanas


Málaga, Málaga, España Epam Systems A tiempo completo

Job Summary

We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Apache Spark and Scala.

Key Responsibilities

  • Develop and maintain data pipelines using Apache Spark and Scala
  • Collaborate with cross-functional teams to design and implement data solutions
  • Consult with analysts and data scientists to build and improve data products
  • Redevelop legacy pipelines to new, advanced, and standard versions
  • Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala

Requirements

  • Expertise in Apache Spark along with Spark streaming
  • Good hands-on experience with Databricks and delta-lake
  • Fluency in Scala programming language
  • Expertise in SQL
  • Good understanding & hands-on experience with CI/CD
  • Rich working experience with GitHub
  • Fluency working with AWS landscape
  • Ability to build Apache Airflow pipelines

About EPAM

EPAM is a leading digital transformation services and product engineering company with over 52,800 EPAMers in more than 55 countries and regions. We are committed to helping our clients and communities around the world make the future real.

Why Join EPAM?

  • Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays
  • Craft your personal Career Development Plan to align with your learning objectives
  • Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses
  • Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager


  • Málaga, Málaga, España Ebury A tiempo completo

    About EburyEbury is a leading FinTech firm that offers a range of innovative financial solutions, including FX risk management, trade finance, currency accounts, international payments, and API integration.Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Data Platform Engineering team in Málaga. As a Senior...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Quantexa A tiempo completo

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Quantexa. As a Senior Data Engineer, you will play a key role in designing, implementing, and maintaining our data processing systems.Key ResponsibilitiesDesign and implement data processing systems using Scala, Java, and Python.Collaborate with cross-functional teams to...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Epam Systems A tiempo completo

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Epam Systems. As a Senior Data Engineer, you will be responsible for designing, developing, and operating data pipelines, integrating high-quality datasets for analytical use-cases, and enabling other data teams to follow client standards.Key ResponsibilitiesDesign and...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Quantexa Limited A tiempo completo

    Unlock the Power of DataAt Quantexa Limited, we're pushing the boundaries of data analytics. As a Senior Data Engineer, you'll be part of our innovative team that's been making waves in the industry since 2016. Our technology has come a long way, from its FinTech roots to its current limitless potential.As a key member of our Quantexa Delivery team, you'll...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Epam A tiempo completo

    We are seeking a highly skilled Senior Data Engineer to join our team at EPAM. As a Senior Data Engineer, you will be responsible for designing, developing, and operating data pipelines using Databricks and Azure.Key Responsibilities:Design and develop high-quality data pipelines using Databricks and AzureIntegrate datasets for analytical use casesEnable...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Epam Systems A tiempo completo

    We are seeking a highly skilled Senior Data Engineer with expertise in Palantir Foundry to join our team of experts.As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data pipelines using PySpark, as well as entity resolution and data science tasks.Key responsibilities include:Data ingestion of multiple sources into...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Epam Systems A tiempo completo

    We are looking for a Senior Data Engineer with a strong background in software engineering and data expertise to join our team of experts. The ideal candidate will have experience in Databricks, Python, and SQL, and be able to work in a highly agile environment following XP practices and best CI/CD practices.The successful candidate will be responsible for...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at EPAM. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing innovative analytical solutions using Cloud Native, Big Data, and NoSQL related technologies.Key ResponsibilitiesDevelop and implement Cloud/On-Premise/Hybrid solutions...

  • Senior Data Engineer

    hace 3 semanas


    Málaga, Málaga, España Epam A tiempo completo

    Description As a Senior Data Engineer at EPAM, you will design, develop, monitor, and operate data pipelines, ensuring high-quality datasets for analytical use-cases. You will enable other data teams to follow client standards and maintain existing data pipelines, including alerting and bug fixing. Our team is composed of experienced engineers, analysts,...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Ebury A tiempo completo

    About the RoleEbury is a leading FinTech firm seeking a skilled Senior Data Engineer to join its Data Platform Engineering team. As a key member of the team, you will be responsible for developing, enhancing, and maintaining robust frameworks and best practices to support analytics and ML initiatives.Key ResponsibilitiesEstablish performance monitoring to...


  • Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks to join our team at EPAM. As a Senior Data Engineer, you will be responsible for designing, developing, and operating data pipelines using Databricks and other ETL tools.Key ResponsibilitiesDesign and develop high-quality data pipelines using Databricks and other ETL...


  • Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Senior Big Data Software Engineer to join our team at EPAM. As a Senior Big Data Software Engineer, you will be responsible for designing, developing, and implementing innovative analytical solutions using cloud-native technologies.You will work closely with our product and engineering teams to understand...


  • Málaga, Málaga, España Tradingview Inc A tiempo completo

    About UsWe're a leading provider of financial data and charts, used by thousands of websites globally. Our mission is to help millions succeed by providing high-quality information.Our TeamWe're a UK-based team part of Tradingview Inc, with a start-up vibe and major scale-up resources.Technology StackWe work with cutting-edge technologies, including...


  • Málaga, Málaga, España Epam A tiempo completo

    Senior Data DevOps EngineerWe are seeking an experienced Senior Data DevOps Engineer to join our team at EPAM.This role will involve managing the day-to-day operation of big data technologies, ensuring consistent performance and reliability. The ideal candidate will have a strong understanding of data platform tools, processes, and engineering...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Senior Data DevOps Engineer to join our team at EPAM. As a key member of our data platform team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key ResponsibilitiesManage the day-to-day operation of big data technologies to ensure consistent performance...

  • Senior Data Engineer

    hace 3 semanas


    Málaga, Málaga, España Ebury A tiempo completo

    About the RoleEbury is a fast-growing FinTech firm that offers a range of products including FX risk management, trade finance, currency accounts, international payments, and API integration. As a Senior Data Engineer, you will be part of our Data Platform Engineering team, responsible for developing and maintaining Ebury's Data Warehouse.About the TeamOur...

  • Senior Data Architect

    hace 1 semana


    Málaga, Málaga, España Ebury A tiempo completo

    Ebury's strategic growth plan relies heavily on our Data team, and we are seeking a Senior Data Architect to join our Data Platform Engineering team. As a skilled Senior Data Engineer with a strong focus on building and optimizing data platforms, you will develop, enhance, and maintain robust frameworks and best practices to support analytics and ML...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Ebury A tiempo completo

    About the RoleEbury is a leading FinTech firm, recognized for its innovative approach to financial services. We offer a range of products, including FX risk management, trade finance, currency accounts, international payments, and API integration.Job SummaryWe are seeking a skilled Senior Data Engineer to join our Data Platform Engineering team. The...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Ebury A tiempo completo

    About Our Data TeamEbury's strategic growth plan relies heavily on our Data team, and we're seeking a Senior Data Engineer to join our Data Platform Engineering team. Our data mission is to develop and maintain Ebury's Data Warehouse, serving it to the whole company. We work collaboratively with Data Scientists, Data Engineers, Analytics Engineers, and Data...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga, España Ebury A tiempo completo

    About the RoleWe are seeking a skilled Senior Data Engineer to join our growing Data Platform Engineering team at Ebury. As a key member of our data mission, you will be responsible for developing, enhancing, and maintaining robust frameworks and best practices to support our analytics and ML initiatives.Key ResponsibilitiesEstablish performance monitoring...