DataOps Engineer

hace 3 meses

Seville, España Admiral Seguros A tiempo completo

Role Description

Configure/maintain/apply security patches to the infrastructure on which the data platform is based, ensure the deployment and the CI/CD of the data or ML delivery. Monitor the performance of the data pipeline and/or the ML models.



Key Objectives 

  • Implement and configure the tools needed to access our data and manipulate it 
  • apply security patches to the different infrastructural components
  • Work with the Data Architect to ensure development is aligned with the target architecture.
  • Develop and deploy the delivery pipelines involved in the Data Platform .
  • Operationalize the ML models within the Data Platform.
  • Maintain and monitor the different environments for each country.


Main Responsibilities 

  • Maintain an agile mindset every day.
  • Interact with security, networking and platform teams to have a secure infrastructure and guarantee a stable environment to the stakeholders
  • deployment of the pipeline to ensure high quality and efficiency of the release process and also in the productive environment.
  • They work closely with the Data Architect to monitor the target architecture.
  • Communicate with Scrum Master to escalate impediments or improvement for the wagon.
  • They work closely with the data scientist to operationalize the ML models within the Data Platform.
  • They work closely with the Product Owner and Scrum Master to execute the task assigned to achieve the goal of the wagon. 

  • You will participate in team and train ceremonies: PI planning, Sprint planning, Retrospectives, Daily scrum or stand up meetings.




Requirements:

This is you

  • You are enthusiasm to work in an European team to develop the technical capabilities in a common European Data Platform 
  • Have an Agile mind-set and you are open to new ideas and creative ways to work
  • You are organized and get things done
  • Must have:
  • Spark, PySpark, Python, SQL
  • Docker, Git, Gitflow, Jupyter Notebook, pip, R, Java
  • AWS Cloud Services (EKS, EC2, S3, VPC, RDS, IAM, SQS, SNS, ECS, ECR, Fargate, API Gateway, CloudWatch, CloudFront, RedShift, Kinesis, Glue, Athena, GuardDuty, Inspector, Transcribe, Polly, Lex...)  
  • IaC : Terraform, Cloudformation, CDK
  • Nice to have:
  • Data warehouses modeling

  • BI tools: Microstrategy, Quicksight,Tableau