Lead Data Engineer

hace 5 meses

Málaga provincia, España GemPool Recruitment A tiempo completo

Lead Data Engineer

Job Title:
Lead Data Engineer

Brief Summary of Job

We are looking for a dynamic, details oriented Lead Data Engineer to work on some of our customers most valuable data initiatives.

Working on high impact projects, the Lead Data Engineer will develop designs that support our customers needs, while defining and driving standards in how Spark creates best in breed modern data platforms.

Time spent - Collaborate with cross-functional teams, including Internal I.T stakeholders, Spark

engineers, and business stakeholders, to translate business requirements into technical specifications and designs.
- Leading small POC’s with engineers to understand viability of new tools or design patterns
- Work with delivery team to solve design problems or constraints during delivery - Defining design patterns and best practices for different data processing patterns or

technologies, keeping abreast of the latest advancements.

**Responsibilities**:

- Own the technical delivery of a Data Engineering project segment, showcasing your expertise and leadership skills.
- Collaborate with cross-functional agile teams and stakeholders to understand business and technical requirements, ensuring seamless alignment.
- Lead and mentor a team of talented data engineering professionals, guiding them towards successful project execution.
- Independently handle technical responsibilities while overseeing the work of other team members, ensuring high-quality deliverables.

Skills/Experience
- Strong academic record including a Bachelor’s or Master’s degree in Computer Science, Physics, Mathematics, or other quantitative disciplines
- 8+ years of experienced building and integrating data platform components across various stages of analytical value chain (Ingestion, storage, modelling, processing)
- Extensive knowledge of SQL, Python, Spark, or other relevant data processing languages or frameworks
- 7+ years proven industry experience working with the Cloud Platform Data Services (AWS Redshift, EMR, Glue, Athena, Azure Synapse & Data Factory)
- 7+ years of experience in designing, building, maintaining, and troubleshooting cloud infrastructure (AWS | Azure)
- Experience with cloud data streaming technologies (AWS Kinesis, Kafka, Azure Streams) and associated design patterns

business requirements and design innovative data solutions. Strong leadership abilities, with the capacity to provide technical leadership to the

Data Engineering team to drive successful project outcomes. The ability to take ownership of problems end to end and find creative solutions. Excellent interpersonal skills, verbal, and written communication skills; a team player

and keen learner who loves building great things together. Comfortable presenting solutions to technical and non-technical audience Knowledge & experience with of any of these (desirable): Apache Airflow,

DataBricks, Snowflake, Scala, ML/AI Services (AWS Sagemaker, Azure ML Studio), Kubernetes and Microservices Architecture,

  • Lead Mechanical Engineer

    hace 2 meses

    Málaga, Málaga provincia, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Data Software Engineer

    hace 3 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    Job Title: Lead Data Software EngineerWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems.Key Responsibilities:Develop and operate critical data pipelines using Apache Spark,...

  • Lead Data Software Engineer

    hace 3 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    Job Title: Lead Data Software EngineerWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems.Key Responsibilities:Develop and operate critical data pipelines using Apache Spark,...

  • Lead Data Software Engineer

    hace 2 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    Job DescriptionWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key Responsibilities:Develop and maintain complex data pipelines using Scala,...

  • Lead Data Software Engineer

    hace 3 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key ResponsibilitiesDevelop and maintain complex data pipelines using Scala,...

  • Lead Data Software Engineer

    hace 3 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key ResponsibilitiesDevelop and maintain complex data pipelines using Scala,...

  • Lead Mechanical Engineer

    hace 2 semanas

    Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    Lead Mechanical EngineerRoyal HaskoningDHV is a leading design and engineering firm in the data center industry, and we are seeking a skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team. As a key member of our team, you will work with demanding clients and collaborate with colleagues across the globe to deliver...

  • Lead Mechanical Engineer

    hace 2 semanas

    Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    Lead Mechanical EngineerRoyal HaskoningDHV is a leading design and engineering firm in the data center industry, and we are seeking a skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team. As a key member of our team, you will work with demanding clients and collaborate with colleagues across the globe to deliver...

  • Lead Data Software Engineer

    hace 3 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key ResponsibilitiesDevelop and maintain complex data pipelines using Scala,...

  • Lead Data Software Engineer

    hace 3 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key ResponsibilitiesDevelop and maintain complex data pipelines using Scala,...

  • Platform Engineer Lead

    hace 2 meses

    Málaga, Málaga provincia, España Two Circles A tiempo completo

    Two Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience. We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA. We have 650 Two Circlers working across the globe in three regions, across eight...

  • Lead Data Software Engineer

    hace 4 días

    Málaga, Málaga, España Epam A tiempo completo

    About the RoleEPAM is seeking a highly skilled Lead Data Software Engineer to join our team. As a key member of our data engineering team, you will be responsible for developing, monitoring, and operating critical curated data pipelines at clients. Your expertise in Apache Spark, Scala, and Databricks will be instrumental in building and continuously...

  • Lead Mechanical Engineer

    hace 2 semanas

    Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    Job SummaryWe are seeking a highly skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team. As a key member of our team, you will be responsible for delivering mechanical work packages in multiple projects, identifying scope, design, and management objectives, and ensuring the quality and flow of information required...

  • Lead Mechanical Engineer

    hace 2 meses

    Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Mechanical Engineer

    hace 2 meses

    Málaga, España Royal Haskoningdhv A tiempo completo

    .The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Mechanical Engineer

    hace 2 meses

    Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people.Data centers make this 21st century transformation possible and reliable systems and continuity are crucial.Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a well-established...

  • Lead Data Software Engineer

    hace 1 semana

    Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Apache Spark and Databricks.Key ResponsibilitiesDevelop and operate critical data pipelines processing hundreds of millions of records.Collaborate with...

  • Lead Mechanical Engineer

    hace 2 semanas

    Málaga, Málaga, España Royal HaskoningDHV A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Mechanical Engineer to join our Mission Critical Facilities team at Royal HaskoningDHV. As a key member of our team, you will be responsible for delivering mechanical work packages in multiple projects, identifying scope, design, and management objectives, and ensuring the quality and flow of information...

  • Senior Data Engineer

    hace 7 días

    Málaga, Málaga provincia, España Ebury A tiempo completo

    Ebury is a hyper-growth FinTech firm, named in 2021 as one of the top 15 European Fintechs to work for by AltFi. We offer a range of products including FX risk management, trade finance, currency accounts, international payments and API integration. **Senior Data Engineer - Data Platform Engineering - Fintech** **Málaga Office - Hybrid: 4 days in the...

  • Cloud Engineer Lead

    hace 2 semanas

    Málaga, Málaga, España Two Circles A tiempo completo

    Cloud Engineer LeadTwo Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience.We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA.We are currently looking for an experienced Lead Cloud Engineer to...