Big Data Infrastructure Engineering

hace 2 semanas

Madrid, España Swiss Re A tiempo completo

About The Team

We in the Stargate Platform Engineering team, are searching for an enthusiastic students passioned for Big Data Infrastructure and DevOps Engineer. We focus on optimizing data intensive distributed systems, building and improving data pipelines while making our platform more efficient, secure and resilient. Our team members range from PhD in Mathematics to contributors to open-source Apache Big Data projects. Whether you are a fresh graduate or more experienced professional, we look forward to getting to know you.

If you join us, you will be able to participate in a variety of interesting initiatives. For example, you will:

· Help us improve the resilience of the world by modelling/interpreting/studying real-world data. Transforming terabyte large datasets using hundreds of cores is normal day of work.

· Develop and maintain both declarative and imperative infrastructure system on a multicloud environment. From ARM templates and CloudInit on completely immutable servers to Puppet and python scripts.

· Analyse Data ingestions and bottlenecks to improve the latency of data pipelines. Maximizing Network I/O throughput, improving query plans or even simply fixing connectivity issues between data sources and data ingestion systems.

· Write Big Data pipelines and analyse how data-lineage is handled in a global company in a petabyte scale.

· Work on a day-to-day basis with Palantir software engineers, using state-of-the-art concepts for solving technical problems.

· Translate Infrastructure findings into actionable dashboards, distilling right large datasets into actionable insights for operational users.

· Helping other internal customers making better use of the data platform, by providing guidance and handling Issues they may raise internally. You will advise these customers on how to efficiently ingest terabytes data from a relational database or millions of records Kafka topic to the platform.

We are a diverse team and our passion to learn is what connects us. We are looking for a person who loves to learn and we will support you in this journey We reserve time for studying and exams.

About You

Nobody is perfect and meets 100% of requirements. If you however meet some of the criteria below and are genuinely curious about the world of data science, we will be happy to meet you.

In order to be successful in the role, you need to ideally have these technical skills and knowledge:

- Studying PhD, Master or final year of Bachelors degree in Computer Science, Computer/Electronics Engineering, Applied Mathematics, Physics or related quantitative field.

- Good knowledge of Python and/or Java programming languages.

- Knowledge of Apache Spark.

- Knowledge of computer networks.

- Knowledge of database internals.

The following items are a plus:

- Background in DevOps / Infrastructure Engineering.

- Experience in distributed computing/ databases.

- Passionate about high-performance-computing, functional programming, and constant optimizations.

- AWS/Azure/GCP/Palantir/Databricks Certificates.

- Experience handling tickets and guiding customer in their learning process.

We look forward to receiving your application

About Swiss Re

Swiss Re is one of the world’s leading providers of reinsurance, insurance and other forms of insurance-based risk transfer, working to make the world more resilient. We anticipate and manage a wide variety of risks, from natural catastrophes and climate change to cybercrime. Combining experience with creative thinking and cutting-edge expertise, we create new opportunities and solutions for our clients. This is possible thanks to the collaboration of more than 14,000 employees across the world.

Our success depends on our ability to build an inclusive culture encouraging fresh perspectives and innovative thinking. We embrace a workplace where everyone has equal opportunities to thrive and develop professionally regardless of their age, gender, race, ethnicity, gender identity and/or expression, sexual orientation, physical or mental ability, skillset, thought or other characteristics. In our inclusive and flexible environment everyone can bring their authentic selves to work and their passion for sustainability.

Keywords:   
Reference Code:  129669

  • Big Data Infrastructure Engineering

    hace 2 semanas

    Madrid, Madrid, España Swiss Re A tiempo completo

    About The Team We in the Stargate Platform Engineering team, are searching for an enthusiastic students passioned for Big Data Infrastructure and DevOps Engineer. We focus on optimizing data intensive distributed systems, building and improving data pipelines while making our platform more efficient, secure and resilient. Our team members range from PhD in...

  • Big Data Spark/Scala

    hace 3 días

    Madrid, España Tecdata Engineering A tiempo completo

    En Tecdata Engineering estamos en busca de un Big Data Spark/Scala con inglés avanzadoPERFIL Big Data Spark/Scala Experiencia 2-3 años Perfil funcional con experiencia en gestión de equipos y proyectos Conocimientos en SAS Se valora experiencia en Big Data Spark/Scla Imprescindibles ingles alto

  • Big Data Spark/Scala

    hace 4 días

    Madrid, España TECDATA ENGINEERING A tiempo completo

    En Tecdata Engineering estamos en busca de un Big Data Spark/Scala con inglés avanzado PERFIL Big Data Spark/Scala Experiencia 2-3 años Perfil funcional con experiencia en gestión de equipos y proyectos Conocimientos en SAS Se valora experiencia en Big Data Spark/Scla Imprescindibles ingles alto

  • Data/Big Data Java/Spark

    hace 2 semanas

    Madrid, España Tecdata Engineering A tiempo completo

    ¡Únete a nuestro equipo remoto como Data/Big Data Java/Spark! ¡Estamos buscando un desarrollador con al menos 2 años de experiencia para unirse a nuestro equipo dinámico y apasionado en el campo de Data/Big Data!Responsabilidades:Desarrollo, pruebas y despliegue de microservicios con Java y Spring Boot.Definición y ejecución de pruebas unitarias,...

  • Big Data Architect

    hace 1 mes

    Madrid, España Movilges Intersoft A tiempo completo

    We are recruiting a **Big Data Architect (M/F) **to strengthen our team in Madrid, with the possibility of working in a hybrid mode. **What we are looking for**: - Minimum of 5 years of experience en Big Data implementation projects; - Proven experience in design of Big Data and Data analytics solutions according to customer requirements; - Excellent...

  • Arquitecto Big Data

    hace 4 semanas

    Madrid, España Irium A tiempo completo

    En IRIUM nos preocupamos porque no dejes de perseguir tus sueños. Prepárate para conquistar tus metas, y ten siempre presente disfrutar del camino.Estamos buscando a un Arquitecto Big Data para proyecto estable.¿Qué buscamos?:*Solo candidatos que residan en España.Conocimientos y experiencia en:Arquitectura Big Data con diferentes herramientas y...

  • Arquitecto Big Data

    hace 1 semana

    Madrid, España Irium - Spain A tiempo completo

    En IRIUM nos preocupamos porque no dejes de perseguir tus sueños. Prepárate para conquistar tus metas, y ten siempre presente disfrutar del camino. Estamos buscando a un Arquitecto Big Data para proyecto estable. ¿Qué buscamos?: *Solo candidatos que residan en España. Conocimientos y experiencia en: Arquitectura Big Data con diferentes...

  • Arquitecto Big Data

    hace 4 semanas

    Madrid, España Irium - Spain A tiempo completo

    En IRIUM nos preocupamos porque no dejes de perseguir tus sueños. Prepárate para conquistar tus metas, y ten siempre presente disfrutar del camino. Estamos buscando a un Arquitecto Big Data para proyecto estable. ¿Qué buscamos?: *Solo candidatos que residan en España. Conocimientos y experiencia en: Arquitectura Big Data con diferentes herramientas y...

  • Data Engineering Lead

    hace 1 mes

    Madrid, España Sport Business Talent A tiempo completo

    **Sport Business Talent** is working with **OBS** ( Olympic Broadcast Services) to recruit a: **Data Engineering Lead** **Environment**: We are looking for a Data Engineering Lead to join the Olympics Digital Data & Analytics team. - This role would suit a strong data engineer who wants to evolve into a data engineering leader - If you have a solid...

  • Data Engineering Lead

    hace 1 mes

    Madrid, España Threecolts A tiempo completo

    Salary £80,000 plus benefits We are Threecolts! A leading software suite for Amazon businesses. We acquire, launch, and grow ecommerce software. We are well capitalized to be able to take our business to the next level. We are scaling quickly and have over 100 team members speaking 17 different languages in over 33 countries across 5 continents who all...

  • Arquitecto Big Data

    hace 1 semana

    Madrid, España Grupo Ns A tiempo completo

    **Arquitecto Big Data**:Madrid - Publicada el 12 de abril de 2024DescripciónDese Grupo NS, buscamos un perfil con experiência en definición de arquitectura Big Data con diferentes herramientas y entornos: Cloud (AWS, Azure y GCP), Cloudera, Bases de datos no-sql (Cassandra, Mongo DB), Databricks, ELK, Kafka, Snowflake, etc.Aconsejable:Experiência en...

  • Big Data Engineer

    hace 4 semanas

    Madrid, España Vodafone A tiempo completo

    **About the role**: Our team will be responsible for migrating legacy analytic & business intelligence solutions and their associated data pipelines across Vodafone onto the Google Cloud Platform, enhancing and developing new solutions. The Data Engineer delivers data pipelines and data service components. This will be at an industrial scale delivering 20+...

  • Big Data Architect

    hace 4 semanas

    Madrid, España Infortec Consultores A tiempo completo

    **Descripción**: En Infortec Consultores ¡Continuamos ampliando nuestro equipo!. Actualmente contamos con un importante y estable proyecto en el que precisamos incorporar un perfil de ARQUITECTO/A BIG DATA. **Requisitos**: - Mínimo 5 años de experiência en proyectos de implementación de Big Data. - Experiência contrastada en diseño de soluciones...

  • Big Data Architect

    hace 1 semana

    Madrid, España Infortec Consultores A tiempo completo

    **Descripción**:En Infortec Consultores ¡Continuamos ampliando nuestro equipo!.Actualmente contamos con un importante y estable proyecto en el que precisamos incorporar un perfil de ARQUITECTO/A BIG DATA.**Requisitos**:- Mínimo 5 años de experiência en proyectos de implementación de Big Data.- Experiência contrastada en diseño de soluciones de Big...

  • Data Engineer

    hace 4 semanas

    Madrid, España Ebury A tiempo completo

    Ebury is a hyper-growth FinTech firm, named in 2021 as one of the top FinTechs to work for by Glassdoor and AltFi. We offer a range of products including FX risk management, trade finance, currency accounts, international payments and API integration. **Data Engineer - Data Platform Engineering** **Madrid - 4 days in the **office** **Ebury is a FinTech...

  • Big Data Engineer

    hace 4 semanas

    Madrid, España Juno Projects A tiempo completo

    **Descripción**: **OUR CLIENT** Spanish technology consultancy with more than 28 years of experience in the market and more than 2,300 employees working on national and international projects. Track record: Extensive technological background carrying out complete digital transformations, from customer experience to employee experience, including...

  • Arquitecto Big Data

    hace 4 semanas

    Madrid, España Irium - Spain A tiempo completo

    En IRIUM nos preocupamos porque no dejes de perseguir tus sueños. Prepárate para conquistar tus metas, y ten siempre presente disfrutar del camino. Actualmente nos encontramos en búsqueda de ARQUITECTO BIG DATA (HÍBRIDO/MADRID) con experiencia de al menos cinco años, para un proyecto estable y con posibilidades de crecimiento. Requisitos...

  • Big Data Architect

    hace 1 semana

    Madrid, España Movilges A tiempo completo

    We are recruiting a Big Data Architect to strengthen our team in Madrid, with the possibility of working in a hybrid mode.What we are looking for:Minimum of 5 years of experience en Big Data implementation projects;Proven experience in design of Big Data and Data analytics solutions according to customer requirements;Excellent communication skills, in...

  • Big Data Engineer

    hace 4 semanas

    Madrid, España Infoplus Technologies UK Ltd A tiempo completo

    **Big Data Engineer (Big Data, Spark, Scala)** **Experience** - Experience in creation of pipeline and data evaluation in the big data environment. - Experience in developing (code) software in governed technology systems. - Unit testing experience and the ability to resolve incidents quickly. Understand the testing and governance required in the investment...

  • Consultor Big Data

    hace 4 semanas

    Madrid, España Serviguidebpo A tiempo completo

    Descripción ServiguideTECH, perteneciente al grupo HPS, precisa incorporar un perfil de** Consultor Big Data.** **Ofrecemos**: - Contrato indefinido. - 100% REMOTO - Participación en proyectos y tecnologías innovadores. - Proyectos indefinidos (gran estabilidad). - Empresa en constante evolución. - Buen ambiente de trabajo. - Evolución profesional y...