Real-time Data Engineer
hace 2 semanas
**About this position**:
Work on a challenging mobility project, in which real time data is crucial to give the best service to the traveler and valuable data insights to the operators.
Together with the data engineering team, you'll provide your real time expertise to ingest data, manage messages from different data providers and consolidate everything into the common data lake, all of this in a highly scalable Kubernetes infrastructure.
**Key responsibilities**:
- Design and implement real-time data processing solutions using Kafka and Spark Streaming (and possibly Flink)
- Collaborate with cross-functional teams to ensure the successful integration of real-time data solutions into our products and services
- Optimize the performance and scalability of real-time data systems
- Keep up-to-date on the latest trends and developments in the field of real-time data processing
**Requirements**:
- University **degree in IT** or similar
- Level of English (B2 or higher)
- 1+ years of experience in implementation of **Kafka clusters **and** real-time analytics**:
- 1+ years of experience in **Spark Streaming**:
- 2+ years of experience in **Python**:
- Strong data manipulation skills (specially **SQL**, **Spark SQL** and the **Dataframe API**)
- Ability to design, develop and maintain real-time data processing solutions
- Excellent problem-solving skills and ability to make informed decisions in real time
- Good knowledge of Git
- Good communication skills
- Results faced, self-challenging mentality
- Eager to learn
**Nice to have**:
- Experience with **Apache Flink**:
- Experience with other data-relate Apache products
- Experience with **Kubernetes clusters** or **Rancher**:
- Experience with **Delta Lake**:
- Experience with** Spark in general** and the **Hadoop ecosystem**
- Indefinite
- Full time
- Hybrid (18001, Granada, Granada, Spain)
-
Senior Software Engineer: Real-Time Trading
hace 1 semana
granada, España AgileEngine A tiempo completoA tech company in Spain is seeking a Senior Software Engineer to design and optimize algorithms for real-time market surveillance. Candidates should have 4+ years of experience in Java and Spring, and a background in the trading or blockchain industry. This role offers competitive compensation, opportunities for professional growth, and the flexibility to...
-
Senior Cybersecurity Engineer
hace 1 semana
Granada, España Real-Time Innovations A tiempo completoAre you passionate about protecting the digital world and building secure, resilient products that empower innovation? At RTI, we are looking for a Senior Cybersecurity Engineer to join our dynamic team and help us stay ahead of emerging threats. In this role, you'll lead the analysis of identified vulnerabilities, coordinate their remediation, and drive...
-
Data Engineer
hace 1 semana
Granada, España UNIT4 A tiempo completoCompany DescriptionWe are in Business for People, empowering people in service organizations with innovative Enterprise and Business software solutions. We’ve innovated and taken a new approach to delivering ERP that works for people. Self-driving, adaptive and intuitive software that is changing the way people work. Our solutions empower people and...
-
Data Engineer
hace 5 días
Granada, España UNIT4 A tiempo completoCompany Description We are in Business for People, empowering people in service organizations with innovative Enterprise and Business software solutions. We’ve innovated and taken a new approach to delivering ERP that works for people. Self-driving, adaptive and intuitive software that is changing the way people work. Our solutions empower people and...
-
Data Acquisition Engineer
hace 3 días
Granada, España Walkway A tiempo completoContractor role; US-based company. We operate remotely - most of the Engineering team is CET.About WalkwayWalkway builds AI-driven revenue intelligence for tours and activities. Operators use our platform for real-time analytics, competitive benchmarks, and dynamic pricing. Our data team collects large-scale web and API data to power these insights.The...
-
Data Engineer
hace 5 días
Granada, España Cívica A tiempo completoSomos Cívica Corría el año 2008. El WhatsApp no existía, los datos vivían en Excel y las nubes estaban solo en el cielo. La idea era sencilla de explicar, pero ambiciosa de ejecutar: crear un espacio donde las personas pudiesen colaborar, una consultora tecnológica donde los datos y el desarrollo se unieran para impulsar soluciones a medida, siempre...
-
Software Engineer
hace 1 semana
Granada, España AgileEngine A tiempo completoJob DescriptionAgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas like application development and AI / ML, and our people-first culture has earned us multiple Best Place to Work awards.WHY JOIN USIf you're looking for a place to...
-
Senior Data Engineer
hace 1 semana
Granada, España Ultra Tendency A tiempo completoOur Engineering team is growing, and we're now looking for a Senior Data Engineer - Databricks (m/f/*) to join our team in Spain, supporting our global growth. As Senior Data Engineer (m/f/*), you design and optimize data processing algorithms on a talented, cross-functional team. You are familiar with the Apache open-source suite of technologies and want to...
-
Senior Data Engineer
hace 5 días
Granada, España Ultra Tendency A tiempo completoOur Engineering team is growing, and we're now looking for a Senior Data Engineer - Databricks (m/f/*) to join our team in Spain, supporting our global growth. As Senior Data Engineer (m/f/*), you design and optimize data processing algorithms on a talented, cross-functional team. You are familiar with the Apache open-source suite of technologies and want to...
-
Senior Data Engineer: GCP
hace 6 días
Granada, España T-Systems Iberia A tiempo completoA leading integrated solutions provider seeks a Senior Data Engineer in Granada, Spain. The role involves building data pipelines on Google Cloud Platform, with an emphasis on finance data. Requires strong skills in SQL, Python, and GCP services. You will collaborate closely with finance stakeholders to ensure data accuracy and develop innovative data...