Senior Data Infrastructure Engineer

hace 2 semanas


Amer Girona provincia, España Databricks A tiempo completo

In order to comply with U.S. Government information security and federal contractor regulations, including Department of Defense Cloud Computing Security Requirements for Impact Level 6 Cloud Service Provider personnel, and facilitate compliance with other regulations such as FedRAMP High baseline, and requirements of certain federal contracts, this role is open to United States citizens on United States Soil only.

As a Senior Data Infrastructure Engineer - SRE on the security data infrastructure team you will help build data infrastructure for the security team. You will build reliable, large-scale, multi-geo data pipelines to support detecting threats(internal and external threats) in Databricks systems, incident response forensics analysis and periodic compliance audits. You will build and deploy data pipelines in multi cloud (AWS, Azure and GCP) environments to process data and logs from external SaaS systems.

The impact you will have:

- Architect, build and scale infrastructure for data processing in the cloud (AWS, Azure and GCP).
- Monitor and optimize data and its infrastructure.
- Build data pipelines to collect telemetry and logs from millions of virtual machines running.
- Partner with security engineers, detection engineers and incident response engineers to build bronze, silver, gold quality data sets to meet detection, forensics and compliance needs.
- Develop best practices and standards that can be used by data engineers in the security team to build, optimize and maintain data pipelines.
- Build tools to detect, improve data quality and monitor data pipeline performance.
- Perform on-call rotation(24/7) to support any production issues or troubleshooting production jobs.

What we look for:

- 5+ years of experience in software or data engineering.
- 3+ years of experience in programming with python, scala or SQL. (preference for python)
- 3+ years of experience in building data pipelines using Spark or dataframes.
- 2+ years of experience in AWS, Azure or GCP.
- BS (or higher) in Computer Science, or a related field.
- Comfortable in exploring new tech or finding creative ways to solve problems.
- Experience in security engineering or detection engineering.
- Good communication skills, both written and verbal.
- Experience with NIST 800-53, FedRAMP, and related frameworks is preferred.

**Benefits**
- Comprehensive health coverage including medical, dental, and vision
- 401(k) Plan
- Equity awards
- Flexible time off
- Paid parental leave
- Family Planning
- Gym reimbursement
- Annual personal development fund
- Employee Assistance Program (EAP)

**About Databricks**

Databricks is the data and AI company. More than 9,000 organizations worldwide — including Comcast, Condé Nast, and over 50% of the Fortune 500 — rely on the Databricks Lakehouse Platform to unify their data, analytics and AI. Databricks is headquartered in San Francisco, with offices around the globe. Founded by the original creators of Apache Spark, Delta Lake and MLflow, Databricks is on a mission to help data teams solve the world’s toughest problems. To learn more, follow Databricks on Twitter, LinkedIn and Facebook.

**Our Commitment to Diversity and Inclusion**

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. We take great care to ensure that our hiring practices are inclusive and meet equal employment opportunity standards. Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio-economic status, veteran status, and other protected characteristics.

**Compliance



  • Vizcaya provincia, España Sapindex A tiempo completo

    At Sapindex we have projects for the technological world, that's why we want to meet you. There will be various support and maintenance assignments as well as projects. We are looking for a IT PM Infrastructure/IT Infrastructure Service Manager Deliver to join the team of one of our most important clients from Spain. **Requisitos**: **Responsabilities**: IT...

  • DevOps Engineer

    hace 1 mes


    Mallorca, Illes Balears provincia, España NTT DATA A tiempo completo

    If you are a DevOps Engineer, you might be interested in this... NTT DATA Spain team is looking for a DevOps Engineer in Mallorca to work with our clients in the European Public Sector! As a DevOps Engineer, you will be working with a variety of different clients across multiple industries. We´re looking for enthusiastic, collaborative and digitally...

  • Cloud Engineer

    hace 4 semanas


    Barcelona provincia, España Talent Locker A tiempo completo

    **Cloud Engineer - Spain** - €_60-85k - Fully remote - Must be resident in Spain_ There are multiple vacancies for cloud engineers working in a large insurance company. If you’re looking for your next role from €60-85k, _please apply._ This role is to reduce manual effort by the introduction of automation through programmatic means using code - Power...

  • Big Data Engineer

    hace 4 semanas


    Santa Bàrbara, Tarragona provincia, España Santander A tiempo completo

    Big Data Engineer - Data Lake - Openbank (Openhub Bilbao) Country: Spain **WHAT YOU WILL BE DOING** Data Analytics & Models Analyst

  • Data Platform Engineer

    hace 4 semanas


    Tenerife, Santa Cruz de Tenerife provincia, España dyvenia A tiempo completo

    You will support the design, implementation, and maintenance of our Data Platform. **Overview**: As a Data Platform Engineer, you will: - support the **design, implementation, and maintenance** of our Data Platform. As one of the first team members, you will have a tangible impact on the final product; - use a **mix of modern open-source technologies**,...


  • Girona, España Almirall A tiempo completo

    Mission We are seeking a Data Management Engineer Trainee to join the AIDE group (Artificial Intelligence and Data Engineering) at R&D Data Science team. The ideal candidate will help to organize data from our R&D laboratories, as well as helping to overseeing manage data processing channels to support our research pipeline. The candidate may be...

  • Data Engineer

    hace 4 semanas


    Tres Cantos, Madrid provincia, España beonit A tiempo completo

    _Desde beonit trabajamos para una de las empresas bancarias referentes en España que se dedica al diseño, desarrollo y gestión de soluciones y servicios IT, tanto para las entidades financieras de su grupo como de otros clientes._ **Buscamos un Data Engineer para la **extracción** y preparación de datos trabajando desde el Área de Data Analytics y en...


  • Madrid provincia, España Sharp Brains Ltd A tiempo completo

    **Job Requirements**: 1. Good general understanding of IT principles such as Networks, Hardware and Domains. 2. Knowledge of Infrastructure (Data Center and Network) hardware architecture as to understand the procedure shared by L3 teams during troubleshooting, H&E support. 3. Knowledge of server/client operations in a domain environment including Active...

  • Senior Data Engineer

    hace 2 días


    Sant Cugat del Vallès, Barcelona provincia, España UVE Solutions A tiempo completo

    **Sobre UVE Solutions**: Con 17 años de especialización en el sector gran consumo, somos el partner tecnológico de empresas referentes en el sector alimentación y bebidas, gestionando proyectos en más de 20 países. Guiamos la estrategia comercial de nuestros clientes proporcionándoles las tecnologías y data intelligence para impulsar sus ventas y...


  • Unión, Murcia provincia, España European Recruitment A tiempo completo

    **Senior Digital SoC Verification Engineer - **Artificial Intelligence**/ SystemVerilog / UVM / C/C++** Opportunity to join a leading AI Semiconductor organization to be part of team that is responsible for design and realization of energy-efficient mixed signal neuromorphic processors/SoCs located in Delft, Netherlands is currently seeking a Senior Digital...

  • Network Engineer

    hace 5 días


    Casares, Málaga provincia, España Concept International A tiempo completo

    **Network Engineer - Malaga (Hybrid Working) - €45-65k + package** **Relocation package available!** **Multi-Lingual Client - English & Spanish (and many more)** Are you passionate about network infrastructure and security systems? Do you thrive in a dynamic, cutting-edge tech environment? Join our team and be at the heart of the value chain for a...


  • Amer, Girona provincia, España Remote Technology, Inc. A tiempo completo

    **About Remote**: **All of our positions are fully remote. You do not have to relocate to join us!** **About Remote**: Remote is solving global remote organizations’ biggest challenge: employing anyone anywhere compliantly. We make it possible for businesses big and small to employ a global team by handling global payroll, benefits, taxes, and compliance...


  • Tres Cantos, Madrid provincia, España Siemens Healthineers A tiempo completo

    Looking for a chance to create a positive impact? You are familiar with the tasks of a Scrum Master. We are looking for a new colleague who brings experience with SAFe and helps our three teams, AWS, Azure and Jira to take advantage of Scrum. Beyond that you are coaching the Digital Infrastructure Team in driving the Agile transformation. With us you will...

  • Big Data Engineer

    hace 4 semanas


    Santa Bàrbara, Tarragona provincia, España Santander A tiempo completo

    Big Data Engineer - Data Lake - Openbank (Openhub Valencia) Country: Spain **WHAT YOU WILL BE DOING** **¿QUÉ HARÁS?** We are the 100% digital bank of the Santander Group, and we are currently undergoing a technological transformation and international expansion process. In 2017, we kicked off our relaunch plans and have been continuously expanding and...


  • Amer, Girona provincia, España Remote Technology, Inc. A tiempo completo

    **About Remote**: **All of our positions are fully remote. You do not have to relocate to join us!** **The Position**: The **Sr. Manager, Sales Development - AMER** is a key leadership role within our GTM organization, with considerable scope over the achievement of our pipeline generation and revenue goals for our Employer of Record product line. This role...


  • Tres Cantos, Madrid provincia, España Sener en Aeroespacial A tiempo completo

    En Sener deseamos incorporar en nuestro equipo a una persona para ocupar el puesto de Procurement Engineer en nuestro centro de trabajo de Tres Cantos. Somos una compañía de ingeniería pionera en el diseño de tecnología satelital y equipos para la exploración espacial. En Defensa abordamos el diseño y producción de equipos y sistemas, incluidos los...


  • Unión, Murcia provincia, España European Recruitment A tiempo completo

    **Senior Digital SoC Verification Engineer - Semiconductor / Artificial Intelligence/ UVM / SystemVerilog** - Are you experienced with SystemVerilog and UVM? - Do you have experience with simulating C/C++ software and experience with any microprocessor based chips? - Passionate about Neuromorphic computing/AI? **If so, then this could be the one for...

  • Label, Sku

    hace 4 semanas


    Asturias provincia, España Axalta Coating Systems A tiempo completo

    Job Description: Axalta is looking for an enthusiastic young graduate to join the Refinish Portfolio management team as an intern. This is a 12-month trainee position which will give you the opportunity to step in an amazing industry! What will you be doing? Help with administrative Product Service tasks such as: - Creation and maintenance of the...

  • Data Architect

    hace 4 semanas


    Or, A Coruña provincia, España Optinova A tiempo completo

    Are you a data architect or an experienced data engineer looking for a new challenge? We are seeking a talented individual to join the Optinova team and grow and help us develop our business intelligence solution into a competitive advantage. **The job** As a data architect, you will lead the design, implementation, and operation of a sound information...


  • Unión, Murcia provincia, España European Recruitment A tiempo completo

    **Senior Digital SoC Verification Engineer - Semiconductor / Artificial Intelligence/ UVM / SystemVerilog** - Are you experienced with SystemVerilog and UVM? - Do you have experience with simulating C/C++ software and experience with any microprocessor based chips? - Passionate about Neuromorphic computing/AI? **If so, then this could be the one for...