Senior Engineer, Data Engineering
hace 1 semana
Madrid - Spain # Data EngineerPrima could be the place for you.Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly become the number one online motor insurance provider. To help fuel that growth, we need a **Senior Data Engineer** to join our **Engineering team**.You’ll be joining over 300 engineers across software development, infrastructure, operations and security. Fueled by curiosity, experimentation and collaboration, you’ll help deliver scalable, impactful solutions that shape the future of insurance.You’ll be joining our pricing and underwriting domain to bridge the gap between machine learning/data science and engineering. You will help build, publish, and maintain our complex data products and pipelines, key elements that have a significant impact on the company’s growth.What you’ll do:- Shaping the architecture of data products designed for data analytics and data science specifically focusing on use cases like forecasting, feature engineering, customer behaviour, and integration of new data sources.- Leading the way in data transformation by setting up best practices in areas like Data modelling, performance optimisation, Data Governance etc, ensuring that the data used within Prima is consistent, available and reliable.- Build reusable technology that enables teams to ingest, store, transform, and serve their own data products.- Engaging with data scientists and machine learning engineers to explore the product landscape and refine data requirements for enhanced data infrastructure.- Embrace continuous learning and experimentation to stay updated on emerging technologies, from testing open source tools to engaging in community-building activities like Meetups. What we’re looking for:- Expert in batch, distributed data processing and near real-time streaming data pipelines with technologies like Kafka, Flink, Spark etc. Experience in Data Lake / Big Data Analytics platform implementation with cloud based solution; AWS preferred.- Proficient in Python programming and software engineering best practices.- Expertise with RDBMS, Data Warehousing, Data Modelling with relational SQL (Redshift, PostgreSQL) and NoSQL databases.- Proficiency in DevOps, CI/CD pipeline management, and expertise in infrastructure as Code (IaC) deployment industry-best practices.Nice-to-Have:- Hands-on experience in Data Quality and Data Governance techniques.- Exposure to common data analysis and ML technologies such as on scikit-learn, pandas, NumPy, XGBoost, LightGBM.- Exposure to tools like Apache Oozie, Apache Airflow.**Why you’ll love it here:**We want to make Prima a happy and empowering place to work. Work Your Way:** Enjoy full flexibility - work from home, the office or a mix of both.
-
Senior Engineer, Data Engineering
hace 1 semana
Madrid, España Ultra Tendency A tiempo completoOur Engineering department is growing, and we’re now looking for a Senior Data Engineer - Databricks (m / f / to join our team in Spain, supporting our global growth. Company Overview Ultra Tendency is an international premier Data Engineering consultancy for Big Data, Cloud, Streaming, IIoT and Microservices. We design, build, and operate large-scale...
-
Senior Engineer, Data Engineering
hace 1 hora
Madrid, España Xebia A tiempo completoFor more than 20 years, our global network of passionate technologists and pioneering craftspeople has delivered cutting-edge technology and game-changing consulting to companies on the brink of AI driven digital transformation. Since 2001, we have grown into a full service digital consulting company with 5500+ professionals working on a worldwide ambition....
-
Senior Engineer, Data Engineering
hace 2 semanas
Madrid, España Ultra Tendency A tiempo completoOur Engineering department is growing, and we’re now looking for aSenior Data Engineer - Databricks (m / f /to join our team in Spain, supporting our global growth.Company Overview Ultra Tendency is an international premier Data Engineering consultancy for Big Data, Cloud, Streaming, IIoT and Microservices. We design, build, and operate large-scale...
-
Senior Engineer, Data Engineering
hace 2 días
Madrid, España Ubique Systems A tiempo completoJob Title: Senior Data Lead Engineer Location: Malaga, Spain - Hybrid: 1 Day to Office Every Week Duration: Permanent Employment Type: Contract B2BRoles & Responsibilities: We are seeking aSenior Data Lead Engineerto drive the evolution ofData, AI, and BI platformsforGlobal Transaction Banking (GTB) . You will own the data roadmap, design scalable cloud...
-
Desarrollador de Big Data
hace 2 semanas
Madrid, España Senior Big Data A tiempo completoDesarrollador Senior Big Data – Reporting Regulatorio Ubicación: 100% RemotoRequisitos imprescindibles:+4 años en PySpark (Spark SQL, DataFrames; Spark Streaming valorado).Nivel medio-alto en Scala.Experiencia en Azure Databricks (Unity Catalog, Delta Lake, workflows, job clusters).Orquestación con Azure Data Factory o similares (Autosys,...
-
Senior Engineer, Data Engineering
hace 3 días
Madrid, España HCLTech A tiempo completoOur goal is to strengthen the brand in Spain. We are looking for an expert to work as Data Engineer for Big DataRole & Responsibilities:DatabaseVERTICAMYSQLPOSTGRESQLHortonworks Hadoop DistributionHDFSYARNZOOKEEPERKAFKAFLUMESTORMAMBARIHIVESQOOPNIFIworking Language SpanishHolding a Bachelor's engineering or computer science degree on Big Data
-
Desarrollador/a Big Data
hace 2 semanas
Madrid, España Senior Big Data A tiempo completoDesarrollador Senior Big Data – Reporting RegulatorioUbicación: 100% RemotoRequisitos imprescindibles:+4 años en PySpark (Spark SQL, DataFrames; Spark Streaming valorado).Nivel medio-alto en Scala.Experiencia en Azure Databricks (Unity Catalog, Delta Lake, workflows, job clusters).Orquestación con Azure Data Factory o similares (Autosys,...
-
Senior Engineer, Data Engineering
hace 4 días
Madrid, España HCLTech A tiempo completoOur goal is to strengthen the brand in Spain. We are looking for an expert to work as Data Engineer for Big DataRole & Responsibilities:Por favor, asegúrese de leer atentamente los siguientes detalles antes de enviar cualquier solicitud.DatabaseVERTICAMYSQLPOSTGRESQLHortonworks Hadoop DistributionHDFSYARNZOOKEEPERKAFKAFLUMESTORMAMBARIHIVESQOOP xsgfvud...
-
Senior Engineer, Data Engineering
hace 3 semanas
Madrid, España Astek A tiempo completoAtASTEK Iberia, we are looking for anData Engineer, to join our partner specialized platform for job search and recruitment in Spain. Design and build data pipelines:Develop robust ETL/ELT pipelines to ingest, transform, and load data using AWS services such as S3, Glue, Lambda, and Kinesis into Snowflake. Data modeling & architecture:Create efficient and...
-
Senior data engineer
hace 2 días
Madrid, España Ubique Systems A tiempo completoJob Title: Senior Data Lead Engineer Location: Malaga, Spain - Hybrid: 1 Day to Office Every Week Duration: Permanent Employment Type: Contract B2 B Roles & Responsibilities: We are seeking a Senior Data Lead Engineer to drive the evolution of Data, AI, and BI platforms for Global Transaction Banking (GTB). You will own the data roadmap, design scalable...
