Lead Data Engineer
hace 5 meses
Lead Data Engineer
Job Title:
Lead Data Engineer
Brief Summary of Job
We are looking for a dynamic, details oriented Lead Data Engineer to work on some of our customers most valuable data initiatives.
Working on high impact projects, the Lead Data Engineer will develop designs that support our customers needs, while defining and driving standards in how Spark creates best in breed modern data platforms.
Time spent - Collaborate with cross-functional teams, including Internal I.T stakeholders, Spark
engineers, and business stakeholders, to translate business requirements into technical specifications and designs.
- Leading small POC’s with engineers to understand viability of new tools or design patterns
- Work with delivery team to solve design problems or constraints during delivery - Defining design patterns and best practices for different data processing patterns or
technologies, keeping abreast of the latest advancements.
**Responsibilities**:
- Own the technical delivery of a Data Engineering project segment, showcasing your expertise and leadership skills.
- Collaborate with cross-functional agile teams and stakeholders to understand business and technical requirements, ensuring seamless alignment.
- Lead and mentor a team of talented data engineering professionals, guiding them towards successful project execution.
- Independently handle technical responsibilities while overseeing the work of other team members, ensuring high-quality deliverables.
Skills/Experience
- Strong academic record including a Bachelor’s or Master’s degree in Computer Science, Physics, Mathematics, or other quantitative disciplines
- 8+ years of experienced building and integrating data platform components across various stages of analytical value chain (Ingestion, storage, modelling, processing)
- Extensive knowledge of SQL, Python, Spark, or other relevant data processing languages or frameworks
- 7+ years proven industry experience working with the Cloud Platform Data Services (AWS Redshift, EMR, Glue, Athena, Azure Synapse & Data Factory)
- 7+ years of experience in designing, building, maintaining, and troubleshooting cloud infrastructure (AWS | Azure)
- Experience with cloud data streaming technologies (AWS Kinesis, Kafka, Azure Streams) and associated design patterns
business requirements and design innovative data solutions. Strong leadership abilities, with the capacity to provide technical leadership to the
Data Engineering team to drive successful project outcomes. The ability to take ownership of problems end to end and find creative solutions. Excellent interpersonal skills, verbal, and written communication skills; a team player
and keen learner who loves building great things together. Comfortable presenting solutions to technical and non-technical audience Knowledge & experience with of any of these (desirable): Apache Airflow,
DataBricks, Snowflake, Scala, ML/AI Services (AWS Sagemaker, Azure ML Studio), Kubernetes and Microservices Architecture,
-
Lead Mechanical Engineer
hace 3 meses
Málaga, Málaga provincia, España Royal HaskoningDHV A tiempo completoThe global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...
-
Lead Data Software Engineer
hace 4 semanas
Málaga, Málaga, España Epam Systems A tiempo completoJob DescriptionWe are seeking a highly skilled Lead Data Software Engineer to join our team at EPAM. As a key member of our data engineering team, you will be responsible for designing, developing, and operating large-scale data pipelines using Apache Spark, Databricks, and AWS.Key Responsibilities:Develop and maintain complex data pipelines using Scala,...
-
Platform Engineer Lead
hace 3 meses
Málaga, Málaga provincia, España Two Circles A tiempo completoTwo Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience. We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA. We have 650 Two Circlers working across the globe in three regions, across eight...
-
Lead Data Software Engineer
hace 3 semanas
Málaga, Málaga, España Epam A tiempo completoAbout the RoleEPAM is seeking a highly skilled Lead Data Software Engineer to join our team. As a key member of our data engineering team, you will be responsible for developing, monitoring, and operating critical curated data pipelines at clients. Your expertise in Apache Spark, Scala, and Databricks will be instrumental in building and continuously...
-
Lead Mechanical Engineer
hace 3 días
Málaga, Málaga, España Royal HaskoningDHV A tiempo completoRole SummaryLead Mechanical Engineer for our Mission Critical Facilities team, responsible for delivering top-notch mechanical engineering expertise to our data center clients. As a seasoned professional, you'll lead mechanical work packages, manage project documentation, and develop vendor relationships to ensure the highest quality and efficiency in our...
-
Lead Mechanical Engineer
hace 4 semanas
Málaga, Málaga, España Royal Haskoningdhv A tiempo completoJob SummaryWe are seeking a highly skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team. As a key member of our team, you will be responsible for delivering mechanical work packages in multiple projects, identifying scope, design, and management objectives, and ensuring the quality and flow of information required...
-
Data Engineer
hace 2 meses
Málaga, Málaga provincia, España Ciklum A tiempo completoDescription We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people...
-
Lead Mechanical Engineer
hace 2 meses
Málaga, España Royal HaskoningDHV A tiempo completoThe global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...
-
Lead Mechanical Engineer
hace 2 meses
Málaga, España Royal Haskoningdhv A tiempo completo.The global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...
-
Lead Mechanical Engineer
hace 2 meses
Málaga, España Royal HaskoningDHV A tiempo completoThe global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people.Data centers make this 21st century transformation possible and reliable systems and continuity are crucial.Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a well-established...
-
Lead Mechanical Engineer
hace 1 semana
Málaga, España Royal HaskoningDHV A tiempo completoThe global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people. Data centers make this 21st century transformation possible and reliable systems and continuity are crucial. Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a...
-
Lead Data Software Engineer
hace 4 semanas
Málaga, Málaga, España Epam A tiempo completoAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at EPAM. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Apache Spark and Databricks.Key ResponsibilitiesDevelop and operate critical data pipelines processing hundreds of millions of records.Collaborate with...
-
Lead Mechanical Engineer
hace 4 semanas
Málaga, Málaga, España Royal HaskoningDHV A tiempo completoAbout the RoleWe are seeking a highly skilled Lead Mechanical Engineer to join our Mission Critical Facilities team at Royal HaskoningDHV. As a key member of our team, you will be responsible for delivering mechanical work packages in multiple projects, identifying scope, design, and management objectives, and ensuring the quality and flow of information...
-
Cloud Engineer Lead
hace 4 semanas
Málaga, Málaga, España Two Circles A tiempo completoCloud Engineer LeadTwo Circles is a leading sports marketing agency that specializes in leveraging data and technology to help sports organizations grow their revenue and enhance customer experience.We work with some of the biggest names in sports, including the NFL, Premier League, and UEFA.We are currently looking for an experienced Lead Cloud Engineer to...
-
Data Engineering Team Lead
hace 4 semanas
Málaga, Málaga, España Quantexa A tiempo completoTechnical LeadAt Quantexa, we're innovating the data analytics market in ways no-one else can. Our technology started out in FinTech, helping tackle serious criminal activity. Now, its potential is virtually limitless.We're a real team. Collaborating and constantly engineering better and better solutions. We're ambitious, we think things through and we're on...
-
Senior Data Engineer
hace 4 semanas
Málaga, Málaga provincia, España Ebury A tiempo completoEbury is a hyper-growth FinTech firm, named in 2021 as one of the top 15 European Fintechs to work for by AltFi. We offer a range of products including FX risk management, trade finance, currency accounts, international payments and API integration. **Senior Data Engineer - Data Platform Engineering - Fintech** **Málaga Office - Hybrid: 4 days in the...
-
Senior Data Engineer
hace 2 meses
Málaga, Málaga provincia, España EPAM Systems A tiempo completoDo you have a software engineering background and strong knowledge and experience in Data? Are you an open-minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Data Engineer. RESPONSIBILITIES - Design, develop, monitor, and operate data pipelines - Integrate high-quality datasets...
-
Senior Mechanical Engineer
hace 4 semanas
Málaga, Málaga, España Royal Haskoningdhv A tiempo completoLead Mechanical Engineer (MCF/Data Centres)Royal HaskoningDHV is a leading design and engineering firm in the data centre industry, and we are seeking a skilled Lead Mechanical Engineer to join our Mission Critical Facilities (MCF) Data Centre team.As a Lead Mechanical Engineer, you will work with demanding clients and collaborate with colleagues across the...
-
Electrical Engineer
hace 3 semanas
Málaga, Málaga, España Https:Www.Energyjobline.ComSitemap A tiempo completoData Centre Electrical Engineer RoleWe are partnering with a leading global consulting and engineering company to find an experienced Electrical Engineer for their Spanish-based data centre location. Our client works with major developers in the data centre space and requires an Electrical Engineer to join their team.Key Responsibilities:Engineering...
-
Lead Mechanical Engineer
hace 2 meses
Málaga, España Royal HaskoningDHV A tiempo completoThe global digital revolution is bringing prosperity to more and more countries and regions, benefiting millions of people.Data centers make this 21st century transformation possible and reliable systems and continuity are crucial.Royal HaskoningDHV is one of the five leading design and engineering firms in the data center industry and has a well-established...