Big Data Engineer for Cloud Solutions

hace 3 días


Madrid, Madrid, España Basf A tiempo completo

About Us
BASF Digital Hub Madrid is a pioneering unit that develops innovative digital solutions, creates new customer experiences and business growth, and drives process efficiencies to strengthen BASF's position as a digital leader in the chemical industry. Our team thrives on creativity, experimentation, and collaboration.

Our Mission
We aim to provide organizations with a robust and scalable solution for managing vast data quantities and deriving valuable insights. By leveraging Azure's PaaS components, our platform streamlines Big Data workloads, empowering clients to make informed decisions and propel business expansion.

The Role
We are seeking a highly motivated and detail-oriented DataOps Engineer to develop new software and data pipelines using Python and Databricks, maintain and develop CI/CD pipelines and processes, and ensure the scalability, reliability, and security of our cloud-based Big Data platform built on Azure PaaS components EDL (Enterprise Data Lake).

Responsibilities
- Develop high-quality software to meet user and internal needs.
- Design, implement, and test data pipelines, ensuring data accuracy and consistency.
- Collaborate with users and the data science team to understand their data requirements and provide suitable solutions.
- Work in a cloud environment (Azure and Databricks).
- Test new features and improvements and suggest their implementation if beneficial.
- Demonstrate fluent communication skills in English (spoken and written).

Qualifications
- Bachelor's degree in computer science, information technology, engineering, business, or related fields.
- Minimum 3-4 years' experience as a DataOps Engineer using Azure, Python, Azure Data Factory, and Databricks.
- Strong software engineering and development skills with Python and Git.
- Experience with databases, data structures, and data manipulation.
- Familiarity with automation scripting tools like Azure DevOps pipelines.
- Knowledge of Big Data concepts and Databricks.

Salary and Benefits
- An estimated annual salary of approximately €80,000 - €110,000 based on your qualifications and experience.
- A secure work environment prioritizing your health, safety, and wellbeing.
- Flexible work schedule and home-office options.
- Opportunities for learning and professional development.
- 23 holiday days per year, plus additional cultural days and readjustment time.


  • Big Data Engineer

    hace 2 semanas


    Madrid, Madrid, España Basf A tiempo completo

    About Basf Digital Hub MadridCompany OverviewWe develop innovative digital solutions for Basf, create new customer experiences and business growth, drive efficiencies in processes, and strengthen our position as the digital leader in the chemical industry.Job DescriptionThe role of a Big Data Engineer involves developing and maintaining scalable data...


  • Madrid, Madrid, España Empresa Reconocida A tiempo completo

    **About the Role**At our company, we're committed to innovation and excellence in data management. As a Cloud Data Engineer for Big Data Solutions, you'll play a vital role in developing and implementing scalable data pipelines using Azure's PaaS components.**Responsibilities*** Develop, analyze, improve, and test quality software to meet user and internal...


  • Madrid, Madrid, España Basf A tiempo completo

    About UsBASF Digital Hub Madrid is a leading digital solutions provider for the chemical industry. We believe in innovation, creativity, and collaboration to drive business growth and efficiency.Job DescriptionWe are seeking a highly motivated Cloud Data Engineer to join our team at BASF Digital Hub Madrid. The successful candidate will be responsible for...

  • Data Engineer

    hace 3 semanas


    Madrid, Madrid, España Basf A tiempo completo

    About UsBASF Digital Hub Madrid is a cutting-edge digital solutions development unit focused on delivering innovative, customer-centric experiences and business growth opportunities. Our team collaborates to drive process efficiencies, ensuring BASF's position as a leading digital player in the chemical industry.Job OverviewWe are seeking a skilled DataOps...


  • Madrid, Madrid, España Amazon A tiempo completo

    About Amazon Marketing CloudAmazon Marketing Cloud (AMC) is a cutting-edge analytics product that empowers advertisers to make informed decisions about their cross-channel marketing investments. This secure, privacy-safe, and dedicated cloud-based environment enables easy analytics across multiple, pseudonymized data sets.Our ServicesWe ingest billions of...


  • Madrid, Madrid, España Join - Ats A tiempo completo

    Job DescriptionWe are looking for a skilled Data Engineer to join our team in Madrid. As a Data Engineer, you will play a key role in designing and implementing solutions that process large and unstructured datasets.Responsibilities:Design and implementation of data processing architectures.Develop and implement CI/CD pipeline automation...


  • Madrid, Madrid, España Basf A tiempo completo

    About BASF Digital Hub MadridBASF is a leading chemical company that has been innovating for over 150 years. Our digital hub in Madrid is at the forefront of developing innovative digital solutions for our customers.We are seeking a highly motivated and detail-oriented Cloud Data Distribution Engineer - Big Data Expert to join our team.The RoleWe are looking...


  • Madrid, Madrid, España Amaris A tiempo completo

    **Senior Data Engineer - Madrid, Spain**At Amaris Consulting, we're seeking an exceptional Senior Data Engineer to join our international team in Madrid, Spain. As a key member of our data engineering team, you'll have the opportunity to work on exciting projects, collaborate with talented professionals, and grow your career in a dynamic environment.**About...

  • Data Engineer

    hace 2 meses


    Madrid, Madrid, España Basf Se A tiempo completo

    About the JobWe are seeking a highly motivated and detail-oriented Data Engineer who will be responsible for the development of new and existing software and data pipelines with Python and Databricks and maintaining/developing CI/CD pipelines and processes in an ambitious team. Key Responsibilities:Develop, analyze, improve and test quality software to meet...


  • Madrid, Madrid, España Itjobs A tiempo completo

    About the JobWe are looking for a Data Analytics Expert to join our team at Itjobs in Madrid. This is a long-term freelance contract with a rate of €250-€280 per day, plus VAT.The successful candidate will have at least 5 years of experience in big data implementation projects and excellent communication skills. They will be able to adapt their message...

  • Senior Data Engineer

    hace 2 semanas


    Madrid, Madrid, España Kyndryl A tiempo completo

    Transform your career with Kyndryl, a leading technology services company. As a Senior Data Engineer - Cloud AI Solutions, you'll play a critical role in designing, building, and managing mission-critical systems for our clients.We're looking for a seasoned professional with expertise in Google Cloud Platform (GCP) and experience in implementing data...

  • Big Data Innovator

    hace 2 días


    Madrid, Madrid, España Vodafone A tiempo completo

    We are seeking an experienced Data Engineer to join our team at Vodafone. As a key member of our Big Data and AI department, you will be responsible for designing, developing, and implementing efficient data pipelines that support our business growth.This role is perfect for individuals with a strong background in computer science, telecommunications...

  • Senior Data Engineer Lead

    hace 2 semanas


    Madrid, Madrid, España Infotree Global Solutions A tiempo completo

    Company Overview: Infotree Global Solutions is a full-lifecycle digital engineering firm offering digital advisory through scaled engineering services. Our client serves their customers across 11 innovation hubs in the US, Eastern Europe, and India, combining core competence in engineering with the latest in digital strategy and technology to manage Digital...

  • Data Engineer

    hace 7 días


    Madrid, Madrid, España Cloud Counselage A tiempo completo

    Cloud CounselageWe are seeking a talented and motivated Junior Data Engineer to join our dynamic team. This role presents an exciting opportunity for individuals with a strong foundation in data engineering principles and a desire to grow and develop their skills in a fast-paced environment.What We OfferCompetitive Salary: $80,000 per year based on...

  • Cloud Data Engineer

    hace 2 semanas


    Madrid, Madrid, España Thoughtworks Inc. A tiempo completo

    Job ResponsibilitiesWe are seeking a Cloud Data Engineer to join our team at Thoughtworks Inc. The ideal candidate will have expertise in designing and implementing cloud-based data pipelines, as well as experience with big data tools and frameworks.About the Role:Design and develop cloud-based data pipelines using big data tools and frameworksDevelop data...


  • Madrid, Madrid, España Wlg A tiempo completo

    Wlg, a leading company in the network and security industry, is seeking a skilled Cloud Data Engineer to join their team. Located in Prague, this role offers an exciting opportunity to contribute to the development of innovative cloud-based microservices data pipelines.Job SummaryWe are looking for a talented individual with 7+ years of backend development...

  • Cloud BI Engineer

    hace 1 semana


    Madrid, Madrid, España Otto Group Solution Provider (OSP) GmbH A tiempo completo

    About the JobWe are seeking a talented Cloud BI Engineer to join our team at Otto Group Solution Provider (OSP) GmbH. As a Cloud BI Engineer, you will be responsible for the design and implementation of our new, high-performance and robust BI platform in the Google Cloud for big, fast & smart data. 100% Cloud only.The ideal candidate will have experience in...


  • Madrid, Madrid, España Adroit People Ltd. A tiempo completo

    We are seeking a skilled Senior Cloud Data Engineer to join our team at Adroit People Ltd. in Madrid, Spain. This permanent position offers an attractive salary range of 35,000.00€ - 40,000.00€ per year.Job DescriptionIn this role, you will be responsible for designing, implementing, and managing data pipelines on Google Cloud using Apache Nifi,...


  • Madrid, Madrid, España Salve Consulting A tiempo completo

    We are a remote-friendly company, Salve Consulting, offering competitive salaries and bonuses. Our ideal candidate is a highly skilled Cloud Systems Engineer with at least 3 years of experience in telephony and cloud environments. We provide opportunities to work on innovative cloud solutions, focusing on service optimization for various clients.Job...


  • Madrid, Madrid, España Codeconnect Staffing (Pty) Ltd A tiempo completo

    **Job Title:** Data Engineer: Scalable Data Solutions Specialist**Location:** Kigali, Rwanda**Salary Range:** RWF 3,500,000 - 5,000,000 per month (estimated based on industry standards)Company Overview:Codeconnect Staffing (Pty) Ltd is a leading staffing solutions provider with a focus on delivering top talent to businesses in Africa. We are committed to...