AWS Data Engineer

Hace 5 días

España T-Systems International Jornada completa
Company Description We are one global team, guided by respect, integrity, and a passion for doing better every day. We are looking for skilled Junior Data Engineer to join our team in DBIZ. The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, Operations of the data products on ODE Infrastructure Deployment & Management: Efficiently deploy and manage infrastructure on Google Cloud Platform (GCP) including network architectures (Shared VPC, Hub-and-Spoke), security implementations (IAM, Secret Manager, firewalls, Identity-Aware Proxy), DNS configuration, VPN, and Load Balancing. Data Processing & Transformation: Utilize Hadoop cluster with Hive for querying data, and PySpark for data transformations. Implement job orchestration using Airflow. Work extensively with services like Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Compute Engine, and Composer, all managed through Terraform. Develop and implement Python applications for various GCP services. Integrate and manage GitLab Magenta CI/CD pipelines for automating cloud deployment, testing, and configuration of diverse data pipelines. Implement comprehensive security measures, manage IAM policies, secrets using Secret Manager, and enforce identity-aware policies. Data Integration: Handle integration of data sources from CDI, Datendrehscheibe (FTP servers), TARDIS API's and Google Cloud Storage (GCS). Multi-environment Deployment: Create and deploy workloads across Development (DEV), Testing (TEST), and Production (PROD) environments. Implement AI solutions using Google's Vertex AI for building and deploying machine learning models. Must be a certified GCP Cloud Architect or Data Engineer. Terraform Python GitLab CI/CD Familiarity with network architectures, security implementations, and management of core GCP services. Knowledge in employing data processing tools like and data orchestration tools like Airflow . Familiarity with managing and integrating diverse data sources. Certified GCP Cloud Architect and Data Engineer would be beneficial. T-Social: social initiatives (sports, community, health, ...). Hybrid work model (remote/on-site). Flexible

working hours
. Customized training: access to Coursera to learn whatever you want, whenever you want. Weekly language classes (English & German). Flexible compensation plan (health insurance, meal vouchers, childcare, transport). Social fund. Free access to specialist services (medical, legal, wellness).