Lead Data Software Engineer

hace 2 semanas

Málaga, Málaga, España Epam Systems A tiempo completo
About the Role

We are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM Systems. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark and Databricks.

Key Responsibilities
  • Develop and maintain complex data pipelines using Apache Spark and Databricks
  • Collaborate with analysts, data scientists, and product managers to build and improve data products
  • Redesign and redevelop legacy pipelines to new, advanced, and standard versions
  • Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Requirements
  • Expertise in Apache Spark along with Spark streaming
  • Good hands-on experience with Databricks and delta-lake
  • Fluency in Scala programming language
  • Expertise in SQL
  • Good understanding & hands-on experience with CI/CD
  • Rich working experience with GitHub
  • Fluency working with AWS landscape
  • Ability to build Apache Airflow pipelines
Nice to Have
  • Presto
  • Superset
  • Starburst
  • Oracle & Exasol
About EPAM

EPAM is a leading digital transformation services and product engineering company with over 52,800 EPAMers in more than 55 countries and regions. We help make the future real for our clients and communities around the world.

Why Join EPAM
  • Work & Life Balance: Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays
  • Continuous Learning Culture: Craft your personal Career Development Plan to align with your learning objectives. Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses
  • Clear & Different Career Paths: Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager
  • Strong Professional Community: Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friends

  • Lead Data Software Engineer

    hace 2 semanas

    Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines and systems.Key ResponsibilitiesDevelop and maintain complex data pipelines using Apache Spark, Databricks, and other big...

  • Lead Data Software Engineer

    hace 2 semanas

    Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines and systems.Key ResponsibilitiesDevelop and maintain complex data pipelines using Apache Spark, Databricks, and other big...

  • Lead Data Software Engineer

    hace 1 semana

    Málaga, Málaga, España EPAM Systems A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM Systems. As a key member of our data engineering team, you will be responsible for designing, developing, and operating complex data pipelines using Apache Spark, Databricks, and AWS.Key ResponsibilitiesDevelop and maintain scalable data pipelines using Spark,...

  • Lead Data Software Engineer

    hace 1 semana

    Málaga, Málaga, España EPAM Systems A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM Systems. As a key member of our data engineering team, you will be responsible for designing, developing, and operating complex data pipelines using Apache Spark, Databricks, and AWS.Key ResponsibilitiesDevelop and maintain scalable data pipelines using Spark,...

  • Lead Data Software Engineer

    hace 2 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About the Role:We are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM Systems. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key Responsibilities:Develop and maintain complex data pipelines using...

  • Lead Data Software Engineer

    hace 2 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About the Role:We are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM Systems. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key Responsibilities:Develop and maintain complex data pipelines using...

  • Lead Go Software Engineer

    hace 1 mes

    Málaga, Málaga, España Epam A tiempo completo

    Descripción DESCRIPCIÓN ¿Tienes una sólida formación en ingeniería de software y un profundo conocimiento de Go? ¿Eres un profesional abierto de mente con buenas habilidades en inglés? Si esto te describe, esta podría ser la oportunidad ideal para unirte a EPAM como Lead Go Software Engineer. Nuestros equipos trabajan en entornos altamente...

  • Lead Go Software Engineer

    hace 1 mes

    Málaga, Málaga, España Epam A tiempo completo

    Descripción DETALLES DEL PUESTO ¿Tienes una sólida formación en ingeniería de software y un profundo conocimiento de Go? ¿Eres un profesional con una mentalidad abierta y buenas habilidades en inglés? Si es así, esta podría ser la oportunidad ideal para unirte a EPAM como Lead Go Software Engineer. Nuestros equipos operan en entornos de...

  • Lead Software Backend Engineer

    hace 2 semanas

    Málaga, Málaga, España New Relic A tiempo completo

    About the RoleWe are seeking a highly skilled and experienced Technical Lead to join our team at New Relic. As a Technical Lead, you will be responsible for driving the design, development, and enhancement of our observability platform.Key ResponsibilitiesDrive the design, development, and enhancement of core features and functionalities of our observability...

  • Lead Software Backend Engineer

    hace 2 semanas

    Málaga, Málaga, España New Relic A tiempo completo

    About the RoleWe are seeking a highly skilled and experienced Technical Lead to join our team at New Relic. As a Technical Lead, you will be responsible for driving the design, development, and enhancement of our observability platform.Key ResponsibilitiesDrive the design, development, and enhancement of core features and functionalities of our observability...

  • Lead C++ Software Engineer

    hace 1 mes

    Málaga, Málaga, España Epam A tiempo completo

    Descripción DESCRIPCIÓN ¿Tienes una sólida formación en ingeniería de software y un profundo conocimiento en C++ y redes? ¿Eres un profesional de mente abierta con buenas habilidades en inglés? Si es así, esta podría ser la oportunidad ideal para unirte a EPAM como Lead C++ Software Engineer. Nuestros equipos trabajan en entornos altamente...

  • Lead C++ Software Engineer

    hace 1 mes

    Málaga, Málaga, España Epam A tiempo completo

    Descripción DESCRIPCIÓN ¿Tienes una sólida formación en ingeniería de software y un profundo conocimiento en C++ y redes? ¿Eres un profesional abierto de mente con buenas habilidades en inglés? Si esto te describe, esta podría ser la oportunidad ideal para unirte a EPAM como Lead C++ Software Engineer. Nuestros equipos trabajan en entornos...

  • Senior Data Engineer

    hace 2 semanas

    Málaga, Málaga, España Quantexa Limited A tiempo completo

    About Quantexa LimitedQuantexa Limited is a leading technology company that has been innovating the data analytics market since 2016. Our technology started out in FinTech, helping tackle serious criminal activity, and has since expanded to various domains, including banking, insurance, government, and healthcare.Job SummaryWe are seeking a highly skilled...

  • Technical Lead

    hace 6 días

    Málaga, Málaga, España Quantexa Limited A tiempo completo

    About UsAt Quantexa Limited, we're a tech company that's been innovating the data analytics market since 2016. Our technology started in FinTech, tackling serious criminal activity, and now its potential is virtually limitless. We're a diverse team of 47 nationalities speaking over 20 languages, with nearly half of our colleagues from ethnic or religious...

  • Technical Lead

    hace 6 días

    Málaga, Málaga, España Quantexa Limited A tiempo completo

    About UsAt Quantexa Limited, we're a tech company that's been innovating the data analytics market since 2016. Our technology started in FinTech, tackling serious criminal activity, and now its potential is virtually limitless. We're a diverse team of 47 nationalities speaking over 20 languages, with nearly half of our colleagues from ethnic or religious...

  • Lead Mechanical Engineer

    hace 2 semanas

    Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    About the RoleRoyal HaskoningDHV is a leading design and engineering firm in the data center industry, and we are seeking an experienced Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team.Key ResponsibilitiesManage and deliver mechanical work packages in multiple projects, ensuring the quality and flow of information...

  • Lead Mechanical Engineer

    hace 2 semanas

    Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    About the RoleRoyal HaskoningDHV is a leading design and engineering firm in the data center industry, and we are seeking an experienced Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team.Key ResponsibilitiesManage and deliver mechanical work packages in multiple projects, ensuring the quality and flow of information...

  • Software Engineering Team Lead

    hace 6 días

    Málaga, Málaga, España Emburse A tiempo completo

    About the RoleAs a seasoned software engineer, you will play a key part in shaping the future of Emburse's innovative solutions. With a strong background in Java development and experience working in distributed environments, you will lead our engineering team in delivering scalable and reliable applications that meet business goals.Key ResponsibilitiesLead...

  • Software Engineering Team Lead

    hace 6 días

    Málaga, Málaga, España Emburse A tiempo completo

    About the RoleAs a seasoned software engineer, you will play a key part in shaping the future of Emburse's innovative solutions. With a strong background in Java development and experience working in distributed environments, you will lead our engineering team in delivering scalable and reliable applications that meet business goals.Key ResponsibilitiesLead...

  • Data Architect/Engineer

    hace 2 semanas

    Málaga, Málaga, España Gp Bullhound A tiempo completo

    About Gp BullhoundGp Bullhound is a leading technology investment bank that has been shaping the European tech scene for 20 years. With a strong track record of success, we have worked with prominent companies such as Spotify, Avito, Klarna, Slack, and Revolut, helping them build the future.Your RoleWe are seeking a highly skilled Data Architect/Engineer to...