Lead Data Engineer

hace 7 meses

Málaga provincia, España GemPool Recruitment A tiempo completo

Lead Data Engineer

Job Title:
Lead Data Engineer

Brief Summary of Job

We are looking for a dynamic, details oriented Lead Data Engineer to work on some of our customers most valuable data initiatives.

Working on high impact projects, the Lead Data Engineer will develop designs that support our customers needs, while defining and driving standards in how Spark creates best in breed modern data platforms.

Time spent - Collaborate with cross-functional teams, including Internal I.T stakeholders, Spark

engineers, and business stakeholders, to translate business requirements into technical specifications and designs.
- Leading small POC’s with engineers to understand viability of new tools or design patterns
- Work with delivery team to solve design problems or constraints during delivery - Defining design patterns and best practices for different data processing patterns or

technologies, keeping abreast of the latest advancements.

**Responsibilities**:

- Own the technical delivery of a Data Engineering project segment, showcasing your expertise and leadership skills.
- Collaborate with cross-functional agile teams and stakeholders to understand business and technical requirements, ensuring seamless alignment.
- Lead and mentor a team of talented data engineering professionals, guiding them towards successful project execution.
- Independently handle technical responsibilities while overseeing the work of other team members, ensuring high-quality deliverables.

Skills/Experience
- Strong academic record including a Bachelor’s or Master’s degree in Computer Science, Physics, Mathematics, or other quantitative disciplines
- 8+ years of experienced building and integrating data platform components across various stages of analytical value chain (Ingestion, storage, modelling, processing)
- Extensive knowledge of SQL, Python, Spark, or other relevant data processing languages or frameworks
- 7+ years proven industry experience working with the Cloud Platform Data Services (AWS Redshift, EMR, Glue, Athena, Azure Synapse & Data Factory)
- 7+ years of experience in designing, building, maintaining, and troubleshooting cloud infrastructure (AWS | Azure)
- Experience with cloud data streaming technologies (AWS Kinesis, Kafka, Azure Streams) and associated design patterns

business requirements and design innovative data solutions. Strong leadership abilities, with the capacity to provide technical leadership to the

Data Engineering team to drive successful project outcomes. The ability to take ownership of problems end to end and find creative solutions. Excellent interpersonal skills, verbal, and written communication skills; a team player

and keen learner who loves building great things together. Comfortable presenting solutions to technical and non-technical audience Knowledge & experience with of any of these (desirable): Apache Airflow,

DataBricks, Snowflake, Scala, ML/AI Services (AWS Sagemaker, Azure ML Studio), Kubernetes and Microservices Architecture,

  • Lead Data Engineer

    hace 1 semana

    Málaga, España Mam Gruppe A tiempo completo

    About the Role:As the Lead Data Engineer, you will take on a technical lead position while remaining hands-on, designing and delivering the core infrastructure for this transformative platform.Your responsibilities will include:Designing and building a scalable, cloud-based data platform (AWS, Azure, or GCP).Developing robust ETL/ELT pipelines to ingest,...

  • Lead Mechanical Engineer

    hace 5 meses

    Málaga, Málaga provincia, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Data Software Engineer, Málaga

    hace 7 horas

    Málaga, España Epam A tiempo completo

    Lead Data Software Engineer We are looking for a Lead Data Software Engineer with experience and knowledge in Databricks and open-minded personality who can join our friendly environment and become a core contributor to our team of experts.Do you have background and wide experience in Data engineering and strong knowledge in Databricks?Are you an open-minded...

  • Lead Data Software Engineer, Málaga

    hace 6 horas

    Málaga, España Epam A tiempo completo

    Lead Data Software EngineerWe are looking for a Lead Data Software Engineer with experience and knowledge in Databricks and open-minded personality who can join our friendly environment and become a core contributor to our team of experts.Do you have background and wide experience in Data engineering and strong knowledge in Databricks? Are you an open-minded...

  • Lead Data Solutions Engineer

    hace 4 semanas

    Málaga, Málaga, España Quantexa Limited A tiempo completo

    We're looking for a talented **Lead Data Solutions Engineer** to join our team at Quantexa Limited. As a key member of our data engineering team, this individual will be responsible for designing, developing, and deploying high-quality data processing systems that meet the needs of our clients.With a strong background in data engineering and a passion for...

  • Lead Data Engineer

    hace 4 semanas

    Málaga, Málaga, España Epam Systems A tiempo completo

    About EPAMEPAM Systems is a leading digital transformation services and product engineering company with over 52,650 employees in more than 55 countries and regions. Our multidisciplinary teams have been helping make the future real for our clients and communities around the world since 1993.We offer flexible work options and paid time off for numerous...

  • Senior Data Engineer

    hace 2 meses

    29013 Málaga, Málaga provincia, España A-SAFE Digital A tiempo completo

    **Role Overview**: As a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights. **How you can help us with this role**: - **Data Infrastructure Management**: Maintain and...

  • Platform Engineer Lead

    hace 5 meses

    Málaga, Málaga provincia, España Two Circles A tiempo completo

    Two Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience. We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA. We have 650 Two Circlers working across the globe in three regions, across eight...

  • Senior Data Engineer

    hace 2 meses

    Málaga, España A-Safe Inc. A tiempo completo

    .As a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and efficiency, we...

  • Lead Mechanical Engineer

    hace 4 meses

    Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Senior Data Engineer

    hace 5 días

    Málaga, España A-Safe Group A tiempo completo

    As a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and efficiency, we...

  • Senior Data Engineer

    hace 7 días

    Málaga, España A-Safe Group A tiempo completo

    As a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and efficiency, we...

  • Senior Data Engineer

    hace 2 meses

    Málaga, España A-Safe Inc. A tiempo completo

    As a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and efficiency, we...

  • Lead Mechanical Engineer

    hace 1 mes

    Málaga, España Royal Haskoningdhv A tiempo completo

    .The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Mechanical Engineer

    hace 4 meses

    Málaga, España Royal Haskoningdhv A tiempo completo

    .The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Mechanical Engineer

    hace 1 mes

    Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Mechanical Engineer

    hace 1 semana

    Málaga, España buscojobs España A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st-century transformation possible, and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...

  • Lead Mechanical Engineer

    hace 4 meses

    Málaga, España Royal HaskoningDHV A tiempo completo

    The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people.Data centers make this 21st century transformation possible and reliable systems and continuity are crucial.Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a well-established...

  • Data Engineer

    hace 2 meses

    Málaga, Málaga provincia, España Ciklum A tiempo completo

    Description We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people...

  • Senior Data Engineer

    hace 2 meses

    Málaga, España A-SAFE Inc. A tiempo completo

    As a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and efficiency, we...