Data Engineer
hace 3 días
Overview Job Title: Data Engineer Job Description: Seeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation. Responsibilities Data Pipeline Development: Design, develop, and maintain scalable data pipelines using PySpark to process and transform large datasets. AWS Integration: Utilize AWS services, including Athena and EMR, to manage and optimize data workflows and storage solutions. Data Management: Implement data quality, data governance, and data security best practices to ensure the integrity and confidentiality of data. Performance Optimization: Optimize and troubleshoot data processing workflows for performance, reliability, and scalability. Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs. Documentation: Create and maintain comprehensive documentation of data pipelines, ETL processes, and data architecture. Required Skills and Qualifications Education: Bachelor\'s or Master’s degree in Computer Science, Engineering, or a related field. Experience: 5+ years of experience as a Data Engineer or in a similar role, with a strong emphasis on PySpark. Technical Expertise: Proficient in PySpark for data processing and transformation. Technical Expertise: Extensive experience with AWS services, specifically Athena and EMR. Technical Expertise: Strong knowledge of SQL and database technologies. Technical Expertise: Experience with Apache Airflow is a plus Technical Expertise: Familiarity with other AWS services such as S3, Lambda, and Redshift. Programming: Proficiency in Python; experience with other programming languages is a plus. Problem-Solving: Excellent analytical and problem-solving skills with attention to detail. Communication: Strong verbal and written communication skills to effectively collaborate with team members and stakeholders. Agility: Ability to work in a fast-paced, dynamic environment and adapt to changing priorities. Preferred Qualifications Experience with data warehousing solutions and BI tools. Knowledge of other big data technologies such as Hadoop, Hive, and Kafka. Understanding of data modeling, ETL processes, and data warehousing concepts. Experience with DevOps practices and tools for CI/CD. #J-18808-Ljbffr
-
Data Engineer/BI Engineer
hace 3 semanas
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us.Consulte la descripción del puesto a continuación. Si confía en que tiene las habilidades y la experiencia adecuadas, envíe su solicitud hoy mismo.A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial...
-
Data Engineer/BI Engineer
hace 2 semanas
barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare. Our mission? To offer technological, business, strategy, application...
-
Data Engineer/BI Engineer
hace 3 semanas
Barcelona, España NTT DATA Europe & Latam A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare. Si está considerando enviar una solicitud, asegúrese de pulsar el botón...
-
Data Engineer
hace 22 horas
Barcelona, España Akuaro Work SLU A tiempo completo**Are you a passionate Data Engineer seeking a unique opportunity to leverage your skills and revolutionize the music industry?**: Our partner is a leading provider of software solutions for independent music businesses, and we're searching for a talented Data Engineer to join their dynamic team. In this role, you'll play a pivotal role in building and...
-
Data Engineer
hace 1 día
Barcelona, España TechDelivery A tiempo completoOverview Join to apply for the Data Engineer role at TechDelivery . We are looking for a Data Engineer to join a dynamic team focused on building scalable, secure, and high-performance data solutions. The ideal candidate will have hands-on experience in Big Data environments, strong programming skills, and the ability to work collaboratively with business...
-
Data Engineer
hace 3 días
Barcelona, España Holaluz A tiempo completoJoin to apply for the Data Engineer role at Holaluz Join to apply for the Data Engineer role at Holaluz Are you a data-driven innovator ready to shape the future?Join our team as a Data Engineer, where you'll play a crucial role in transforming raw data into valuable insights that drive business decisions. You'll work alongside a talented team of data...
-
Lead Data Engineer
hace 1 semana
Barcelona, España SHERMIND PARTNERS A tiempo completoLead Data Engineer An ambitious San Fransisco based startup looking for a Lead Data Engineer to scale the team. Requerimientos **Responsibilities**: - Qualifications B. Tech / M. Tech / MS - Drive and manage the data science engineering team to deliver on the sprints and product features - Writing code. This is a senior engineer role. - Provide...
-
Hybrid Data Engineer
hace 7 días
Barcelona, España NTT DATA, Inc. A tiempo completoNTT DATA is all of us. A team of more than 190,000 professionals, as diverse as the more than 50 countries in which we operate and the different sectors in which we operate: telecommunications, financial institutions, industry, utilities, energy, public administration, and healthcare.To offer technological, business, strategy, application development, and...
-
Data Engineer
hace 1 semana
Barcelona, España Axiom Software Solutions Limited A tiempo completoJob Title: Data Engineer Job Description: Seeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation....
-
Data Engineer
hace 7 días
Barcelona, España Axiom Software Solutions Limited A tiempo completoJob Title: Data Engineer Job Description: Seeking a skilled Data Engineer with a robust background in PySpark and extensive experience with AWS services, including Athena and EMR. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data processing systems, ensuring efficient and reliable data flow and transformation....
