Data Engineer
hace 2 semanas
Job TitleData EngineerJob DescriptionSeeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation.Key ResponsibilitiesData Pipeline Development: Design, develop, and maintain scalable data pipelines using PySpark to process and transform large datasets.AWS Integration: Utilize AWS services, including Athena and EMR, to manage and optimize data workflows and storage solutions.Data Management: Implement data quality, data governance, and data security best practices to ensure the integrity and confidentiality of data.Performance Optimization: Optimize and troubleshoot data processing workflows for performance, reliability, and scalability.Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.Documentation: Create and maintain comprehensive documentation of data pipelines, ETL processes, and data architecture.Required Skills and QualificationsEducation: Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.Experience: 5+ years of experience as a Data Engineer or in a similar role, with a strong emphasis on PySpark.Technical Expertise:Proficient in PySpark for data processing and transformation.Extensive experience with AWS services, specifically Athena and EMR.Strong knowledge of SQL and database technologies.Experience with Apache Airflow is a plus.Familiarity with other AWS services such as S3, Lambda, and Redshift.Programming: Proficiency in Python; experience with other programming languages is a plus.Problem-Solving: Excellent analytical and problem-solving skills with attention to detail.Communication: Strong verbal and written communication skills to effectively collaborate with team members and stakeholders.Agility: Ability to work in a fast-paced, dynamic environment and adapt to changing priorities.Preferred QualificationsExperience with data warehousing solutions and BI tools.Knowledge of other big data technologies such as Hadoop, Hive, and Kafka.Understanding of data modeling, ETL processes, and data warehousing concepts.Experience with DevOps practices and tools for CI/CD.#J-18808-Ljbffr
-
Data Engineer
hace 1 día
Barcelona, España Switch Tech Talent A tiempo completoRole: Data Engineer Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtInscríbase rápido, consulte la descripción completa desplazándose hacia abajo para conocer todos los requisitos de este puesto.We’re on the hunt for a talented Data...
-
Data Engineer
hace 2 días
Barcelona, España Switch Tech Talent A tiempo completoRole: Data Engineer Desplácese hacia abajo para encontrar los detalles completos de la oferta de trabajo, incluyendo la experiencia requerida y las funciones y tareas asociadas. Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt We’re on the...
-
Data Engineer
hace 1 día
Barcelona, España Switch Tech Talent A tiempo completoRole: Data Engineer Desplácese hacia abajo para encontrar los detalles completos de la oferta de trabajo, incluyendo la experiencia requerida y las funciones y tareas asociadas. Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt We’re on the...
-
Data Engineer
hace 1 día
Barcelona, España Switch Tech Talent A tiempo completoRole: Data Engineer Salary: Up to €75,000 + equity Type: Permanent Location: Remote / Hybrid (Barcelona) Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbt Inscríbase rápido, consulte la descripción completa desplazándose hacia abajo para conocer todos los requisitos de este puesto. We're on the hunt for a talented Data...
-
Data Engineer
hace 3 días
Barcelona, España Switch Tech Talent A tiempo completoRole: Data EngineerSalary: Up to €75,000 + equityType: PermanentLocation: Remote / Hybrid (Barcelona)Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtWe’re on the hunt for a talented Data Engineer to join our growing Data Team. In this role, you’ll drive the scaling and optimisation of data platforms and integrations,...
-
Data Engineer
hace 1 día
Barcelona, España The BIG Jobsite A tiempo completoRole: Data EngineerSalary: Up to €75,000 + equityType: PermanentLocation: Remote / Hybrid (Barcelona)Key Skills: SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtWe're on the hunt for a talented Data Engineer to join our growing Data Team. In this role, you'll drive the scaling and optimisation of data platforms and integrations,...
-
Data Engineer
hace 3 días
Barcelona, España Switch Tech Talent A tiempo completoRole:¿Todo listo para enviar su solicitud? Asegúrese de comprender todas las responsabilidades y tareas asociadas a este puesto antes de continuar.Data EngineerSalary:Up to €75,000 + equityType:PermanentLocation:Remote / Hybrid (Barcelona)Key Skills:SQL, Python, AWS, Data Pipelines, Redshift/Snowflake, Airflow, dbtWe’re on the hunt for a talented Data...
-
Data Engineer
hace 3 días
barcelona, España Xcede A tiempo completoData Engineer – Barcelona About the company Join a fast-growing global tech unicorn transforming how teams connect and work in real life. With a collaborative, in-person-first culture, you’ll be part of a forward-thinking organisation that values innovation, autonomy, and impact. About the role We’re looking for a Data Engineer to scale our Data Team...
-
Data Engineer
hace 2 días
Barcelona, España Xcede A tiempo completoData Engineer – BarcelonaSolicitar este puesto es sencillo. Desplácese hacia abajo y haga clic en "Solicitar" para ser considerado para esta posición.About the companyJoin a fast-growing global tech unicorn transforming how teams connect and work in real life. With a collaborative, in-person-first culture, you’ll be part of a forward-thinking...
-
Data Engineer
hace 1 día
Barcelona, España Xcede A tiempo completoData Engineer – BarcelonaAbout the companyJoin a fast-growing global tech unicorn transforming how teams connect and work in real life. With a collaborative, in-person-first culture, you’ll be part of a forward-thinking organisation that values innovation, autonomy, and impact.About the roleWe’re looking for a Data Engineer to scale our Data Team and...
