Lead Data Engineer

hace 5 meses


Málaga provincia, España GemPool Recruitment A tiempo completo

Lead Data Engineer

Job Title:
Lead Data Engineer

Brief Summary of Job

We are looking for a dynamic, details oriented Lead Data Engineer to work on some of our customers most valuable data initiatives.

Working on high impact projects, the Lead Data Engineer will develop designs that support our customers needs, while defining and driving standards in how Spark creates best in breed modern data platforms.

Time spent - Collaborate with cross-functional teams, including Internal I.T stakeholders, Spark

engineers, and business stakeholders, to translate business requirements into technical specifications and designs.
- Leading small POC’s with engineers to understand viability of new tools or design patterns
- Work with delivery team to solve design problems or constraints during delivery - Defining design patterns and best practices for different data processing patterns or

technologies, keeping abreast of the latest advancements.

**Responsibilities**:

- Own the technical delivery of a Data Engineering project segment, showcasing your expertise and leadership skills.
- Collaborate with cross-functional agile teams and stakeholders to understand business and technical requirements, ensuring seamless alignment.
- Lead and mentor a team of talented data engineering professionals, guiding them towards successful project execution.
- Independently handle technical responsibilities while overseeing the work of other team members, ensuring high-quality deliverables.

Skills/Experience
- Strong academic record including a Bachelor’s or Master’s degree in Computer Science, Physics, Mathematics, or other quantitative disciplines
- 8+ years of experienced building and integrating data platform components across various stages of analytical value chain (Ingestion, storage, modelling, processing)
- Extensive knowledge of SQL, Python, Spark, or other relevant data processing languages or frameworks
- 7+ years proven industry experience working with the Cloud Platform Data Services (AWS Redshift, EMR, Glue, Athena, Azure Synapse & Data Factory)
- 7+ years of experience in designing, building, maintaining, and troubleshooting cloud infrastructure (AWS | Azure)
- Experience with cloud data streaming technologies (AWS Kinesis, Kafka, Azure Streams) and associated design patterns

business requirements and design innovative data solutions. Strong leadership abilities, with the capacity to provide technical leadership to the

Data Engineering team to drive successful project outcomes. The ability to take ownership of problems end to end and find creative solutions. Excellent interpersonal skills, verbal, and written communication skills; a team player

and keen learner who loves building great things together. Comfortable presenting solutions to technical and non-technical audience Knowledge & experience with of any of these (desirable): Apache Airflow,

DataBricks, Snowflake, Scala, ML/AI Services (AWS Sagemaker, Azure ML Studio), Kubernetes and Microservices Architecture,



  • Málaga, Málaga provincia, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...


  • Málaga, Málaga, España Epam Systems A tiempo completo

    Job DescriptionWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key Responsibilities:Develop and maintain complex data pipelines using Scala,...

  • Platform Engineer Lead

    hace 3 meses


    Málaga, Málaga provincia, España Two Circles A tiempo completo

    Two Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience. We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA. We have 650 Two Circlers working across the globe in three regions, across eight...


  • Málaga, Málaga, España Epam A tiempo completo

    About the RoleEPAM is seeking a highly skilled Lead Data Software Engineer to join our team. As a key member of our data engineering team, you will be responsible for developing, monitoring, and operating critical curated data pipelines at clients. Your expertise in Apache Spark, Scala, and Databricks will be instrumental in building and continuously...


  • Málaga, Málaga, España Royal HaskoningDHV A tiempo completo

    Role SummaryLead Mechanical Engineer for our Mission Critical Facilities team, responsible for delivering top-notch mechanical engineering expertise to our data center clients. As a seasoned professional, you'll lead mechanical work packages, manage project documentation, and develop vendor relationships to ensure the highest quality and efficiency in our...

  • Lead Mechanical Engineer

    hace 4 semanas


    Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    Job SummaryWe are seeking a highly skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team. As a key member of our team, you will be responsible for delivering mechanical work packages in multiple projects, identifying scope, design, and management objectives, and ensuring the quality and flow of information required...

  • Data Engineer

    hace 2 meses


    Málaga, Málaga provincia, España Ciklum A tiempo completo

    Description We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people...


  • Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...


  • Málaga, España Royal Haskoningdhv A tiempo completo

    .The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...


  • Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people.Data centers make this 21st century transformation possible and reliable systems and continuity are crucial.Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a well-established...

  • Lead Mechanical Engineer

    hace 1 semana


    Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...


  • Málaga, Málaga, España Epam A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Apache Spark and Databricks.Key ResponsibilitiesDevelop and operate critical data pipelines processing hundreds of millions of records.Collaborate with...

  • Lead Mechanical Engineer

    hace 4 semanas


    Málaga, Málaga, España Royal HaskoningDHV A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Mechanical Engineer to join our Mission Critical Facilities team at Royal HaskoningDHV. As a key member of our team, you will be responsible for delivering mechanical work packages in multiple projects, identifying scope, design, and management objectives, and ensuring the quality and flow of information...

  • Cloud Engineer Lead

    hace 4 semanas


    Málaga, Málaga, España Two Circles A tiempo completo

    Cloud Engineer LeadTwo Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience.We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA.We are currently looking for an experienced Lead Cloud Engineer to...


  • Málaga, Málaga, España Quantexa A tiempo completo

    Technical LeadAt Quantexa, we're innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless.We're a real team. Collaborating and constantly engineering better and better solutions. We're ambitious, we think things through and we're on...

  • Senior Data Engineer

    hace 4 semanas


    Málaga, Málaga provincia, España Ebury A tiempo completo

    Ebury is a hyper-growth FinTech firm, named in 2021 as one of the top 15 European Fintechs to work for by AltFi. We offer a range of products including FX risk management, trade finance, currency accounts, international payments and API integration. **Senior Data Engineer - Data Platform Engineering - Fintech** **Málaga Office - Hybrid: 4 days in the...

  • Senior Data Engineer

    hace 2 meses


    Málaga, Málaga provincia, España EPAM Systems A tiempo completo

    Do you have a software engineering background and strong knowledge and experience in Data? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Data Engineer. RESPONSIBILITIES - Design, develop, monitor, and operate data pipelines - Integrate high-quality datasets...


  • Málaga, Málaga, España Royal Haskoningdhv A tiempo completo

    Lead Mechanical Engineer (MCF/Data Centres)Royal HaskoningDHV is a leading design and engineering firm in the data centre industry, and we are seeking a skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team.As a Lead Mechanical Engineer, you will work with demanding clients and collaborate with colleagues across the...

  • Electrical Engineer

    hace 3 semanas


    Málaga, Málaga, España Https:Www.Energyjobline.ComSitemap A tiempo completo

    Data Centre Electrical Engineer RoleWe are partnering with a leading global consulting and engineering company to find an experienced Electrical Engineer for their Spanish-based data centre location. Our client works with major developers in the data centre space and requires an Electrical Engineer to join their team.Key Responsibilities:Engineering...


  • Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people.Data centers make this 21st century transformation possible and reliable systems and continuity are crucial.Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a well-established...