Senior Data Engineer
hace 4 semanas
Job Summary
We are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Apache Spark and Scala.
Key Responsibilities
- Develop and maintain data pipelines using Apache Spark and Scala
- Collaborate with cross-functional teams to design and implement data solutions
- Consult with analysts and data scientists to build and improve data products
- Redevelop legacy pipelines to new, advanced, and standard versions
- Leverage and improve a cloud-based tech stack that includes AWS, Databricks, Kubernetes, Spark, Airflow, Python, and Scala
Requirements
- Expertise in Apache Spark along with Spark streaming
- Good hands-on experience with Databricks and delta-lake
- Fluency in Scala programming language
- Expertise in SQL
- Good understanding & hands-on experience with CI/CD
- Rich working experience with GitHub
- Fluency working with AWS landscape
- Ability to build Apache Airflow pipelines
About EPAM
EPAM is a leading digital transformation services and product engineering company with over 52,800 EPAMers in more than 55 countries and regions. We are committed to helping our clients and communities around the world make the future real.
Why Join EPAM?
- Enjoy more of your personal time with flexible work options, 24 working days of annual leave and paid time off for numerous public holidays
- Craft your personal Career Development Plan to align with your learning objectives
- Take advantage of internal training, mentorship, sponsored certifications and LinkedIn courses
- Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery Manager
-
Senior Data Engineer
hace 1 mes
Málaga, Málaga, España Ebury A tiempo completoAbout EburyEbury is a leading FinTech firm that offers a range of innovative financial solutions, including FX risk management, trade finance, currency accounts, international payments, and API integration.Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our Data Platform Engineering team in Málaga. As a Senior...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Quantexa A tiempo completoAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Quantexa. As a Senior Data Engineer, you will play a key role in designing, implementing, and maintaining our data processing systems.Key ResponsibilitiesDesign and implement data processing systems using Scala, Java, and Python.Collaborate with cross-functional teams to...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Epam Systems A tiempo completoJob SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Epam Systems. As a Senior Data Engineer, you will be responsible for designing, developing, and operating data pipelines, integrating high-quality datasets for analytical use-cases, and enabling other data teams to follow client standards.Key ResponsibilitiesDesign and...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Quantexa Limited A tiempo completoUnlock the Power of DataAt Quantexa Limited, we're pushing the boundaries of data analytics. As a Senior Data Engineer, you'll be part of our innovative team that's been making waves in the industry since 2016. Our technology has come a long way, from its FinTech roots to its current limitless potential.As a key member of our Quantexa Delivery team, you'll...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Epam A tiempo completoWe are seeking a highly skilled Senior Data Engineer to join our team at EPAM. As a Senior Data Engineer, you will be responsible for designing, developing, and operating data pipelines using Databricks and Azure.Key Responsibilities:Design and develop high-quality data pipelines using Databricks and AzureIntegrate datasets for analytical use casesEnable...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Epam Systems A tiempo completoWe are seeking a highly skilled Senior Data Engineer with expertise in Palantir Foundry to join our team of experts.As a Senior Data Engineer, you will be responsible for designing and implementing large-scale data pipelines using PySpark, as well as entity resolution and data science tasks.Key responsibilities include:Data ingestion of multiple sources into...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Epam Systems A tiempo completoWe are looking for a Senior Data Engineer with a strong background in software engineering and data expertise to join our team of experts. The ideal candidate will have experience in Databricks, Python, and SQL, and be able to work in a highly agile environment following XP practices and best CI/CD practices.The successful candidate will be responsible for...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Epam A tiempo completoAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at EPAM. As a Senior Data Engineer, you will be responsible for designing, developing, and implementing innovative analytical solutions using Cloud Native, Big Data, and NoSQL related technologies.Key ResponsibilitiesDevelop and implement Cloud/On-Premise/Hybrid solutions...
-
Senior Data Engineer
hace 3 semanas
Málaga, Málaga, España Epam A tiempo completoDescription As a Senior Data Engineer at EPAM, you will design, develop, monitor, and operate data pipelines, ensuring high-quality datasets for analytical use-cases. You will enable other data teams to follow client standards and maintain existing data pipelines, including alerting and bug fixing. Our team is composed of experienced engineers, analysts,...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Ebury A tiempo completoAbout the RoleEbury is a leading FinTech firm seeking a skilled Senior Data Engineer to join its Data Platform Engineering team. As a key member of the team, you will be responsible for developing, enhancing, and maintaining robust frameworks and best practices to support analytics and ML initiatives.Key ResponsibilitiesEstablish performance monitoring to...
-
Senior Data Software Engineer
hace 4 semanas
Málaga, Málaga, España Epam A tiempo completoAbout the RoleWe are seeking a highly skilled Data Engineer with expertise in Databricks to join our team at EPAM. As a Senior Data Engineer, you will be responsible for designing, developing, and operating data pipelines using Databricks and other ETL tools.Key ResponsibilitiesDesign and develop high-quality data pipelines using Databricks and other ETL...
-
Senior Data Scientist Engineer
hace 2 semanas
Málaga, Málaga, España Epam A tiempo completoAbout the RoleWe are seeking a highly skilled Senior Big Data Software Engineer to join our team at EPAM. As a Senior Big Data Software Engineer, you will be responsible for designing, developing, and implementing innovative analytical solutions using cloud-native technologies.You will work closely with our product and engineering teams to understand...
-
Senior Engineer for Market Data Infrastructure
hace 7 días
Málaga, Málaga, España Tradingview Inc A tiempo completoAbout UsWe're a leading provider of financial data and charts, used by thousands of websites globally. Our mission is to help millions succeed by providing high-quality information.Our TeamWe're a UK-based team part of Tradingview Inc, with a start-up vibe and major scale-up resources.Technology StackWe work with cutting-edge technologies, including...
-
Advanced Data Architecture Engineer
hace 3 días
Málaga, Málaga, España Epam A tiempo completoSenior Data DevOps EngineerWe are seeking an experienced Senior Data DevOps Engineer to join our team at EPAM.This role will involve managing the day-to-day operation of big data technologies, ensuring consistent performance and reliability. The ideal candidate will have a strong understanding of data platform tools, processes, and engineering...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Epam A tiempo completoAbout the RoleWe are seeking a highly skilled Senior Data DevOps Engineer to join our team at EPAM. As a key member of our data platform team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key ResponsibilitiesManage the day-to-day operation of big data technologies to ensure consistent performance...
-
Senior Data Engineer
hace 3 semanas
Málaga, Málaga, España Ebury A tiempo completoAbout the RoleEbury is a fast-growing FinTech firm that offers a range of products including FX risk management, trade finance, currency accounts, international payments, and API integration. As a Senior Data Engineer, you will be part of our Data Platform Engineering team, responsible for developing and maintaining Ebury's Data Warehouse.About the TeamOur...
-
Senior Data Architect
hace 1 semana
Málaga, Málaga, España Ebury A tiempo completoEbury's strategic growth plan relies heavily on our Data team, and we are seeking a Senior Data Architect to join our Data Platform Engineering team. As a skilled Senior Data Engineer with a strong focus on building and optimizing data platforms, you will develop, enhance, and maintain robust frameworks and best practices to support analytics and ML...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Ebury A tiempo completoAbout the RoleEbury is a leading FinTech firm, recognized for its innovative approach to financial services. We offer a range of products, including FX risk management, trade finance, currency accounts, international payments, and API integration.Job SummaryWe are seeking a skilled Senior Data Engineer to join our Data Platform Engineering team. The...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Ebury A tiempo completoAbout Our Data TeamEbury's strategic growth plan relies heavily on our Data team, and we're seeking a Senior Data Engineer to join our Data Platform Engineering team. Our data mission is to develop and maintain Ebury's Data Warehouse, serving it to the whole company. We work collaboratively with Data Scientists, Data Engineers, Analytics Engineers, and Data...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga, España Ebury A tiempo completoAbout the RoleWe are seeking a skilled Senior Data Engineer to join our growing Data Platform Engineering team at Ebury. As a key member of our data mission, you will be responsible for developing, enhancing, and maintaining robust frameworks and best practices to support our analytics and ML initiatives.Key ResponsibilitiesEstablish performance monitoring...