Data Engineer

hace 3 semanas

Barcelona, España Antal International Network A tiempo completo

THE PROJECT
Our client is the best technological consultant company, specialist in Microsoft, as well as Dynamics 365 FO, Dynamics 365, AX, Power BI, CRM, EPR, Office 365 and Azure. With offices in Madrid, Barcelona, Valencia and Castellon with specialized professional experts, the company has aided in the development of small businesses through automatization and implantation of Microsoft solutions.
THEROLE
As a Data Engineer/Big Data Developer you will develop and enhance data systems and pipelines, support the process of optimization in extraction, transformation and loading of large data sets, and design solutions with strategic focus on code quality, reliability, reusability, maintainability and dataops, all of which will have an immediate impact on the day-to-day functioning of the company.
Data reporting and visualization to support business operations and decisions.
Design data structures and write code to combine and transform datasets to meet business needs.
Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
Perform statistical analyses on a wide range of datasets.
Convert SAS based pipelines into languages like PySpark, Scala to execute on Hadoop and non-Hadoop ecosystems
Build new datasets proactively; seek out, develop, and share new algorithms and best practices.
Build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python and SQL (Snowflake & SQL Server) in both on premise and cloud environments
Manage and improve the user facing server infrastructure (web + api) including authorization and load balancing
Work with Cloud Computing Platforms (GCP/AWS), Luigi, Kafka and other open-source technologies
Implement both batch and streaming workflows that combine, transform and enrich data utilizing Microsoft Azure
REQUIREMENTS
Bachelor/Master´s in Computer Sc./App or Information Technology
Experience of more 3+ years in a similar role
Microsoft certifications are desirable
Desirable experience on version control (Git), Data Modelling, Data Pipelines, Solution Development, Product Industrialization, CI/CD (Jenkins or Git hub)
Experience using analytics programming languages (Python, Spark, Scala, Java…) to manipulate data and draw insights from large data sets.
Knowledge in machine learning techniques.
Experience in cloud infrastructure such as MS Azure
Experience in agile software development.
Experience with Spark, SQL, NoSQL, Databricks
Knowledge in distributed systems and frameworks such as Hadoop, HBase, NoSQL. Spark SQL, Spark Streaming, HDFS, Hive.
Minimum 2-year experience in: Spark with Scala, SQL, Azure, Power BI, Agile Working
Ability to work individually without much direction while also working as part of a team towards a common goal.
Good written and oral communication skills.
Results-oriented, self-directed ability to drive change in an unstructured environment.
International experience and multicultural skills are highly value
100% remote work
English level:Fluent reading/writing/conversation
Travel availability: Yes, 10% maximum of total working time

#J-18808-Ljbffr

  • Data Engineer | Data Analyst

    hace 3 días

    Barcelona, Barcelona, España ECF Data A tiempo completo

    About ECF DataECF Data is a forward-thinking organization that prioritizes innovation and sustainability in the fashion industry. We're committed to creating a responsible shopping experience and reducing overproduction in fashion.The RoleWe're seeking a highly skilled Data Engineer | Data Analyst to join our team. As a key member of our data team, you will...

  • Data Engineer | Data Analyst

    hace 3 días

    Barcelona, Barcelona, España ECF Data A tiempo completo

    About ECF DataECF Data is a forward-thinking organization that prioritizes innovation and sustainability in the fashion industry. We're committed to creating a responsible shopping experience and reducing overproduction in fashion.The RoleWe're seeking a highly skilled Data Engineer | Data Analyst to join our team. As a key member of our data team, you will...

  • Data Engineer | Data Analyst

    hace 3 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About Ecf Data, LlcEcf Data, Llc is a dynamic and innovative company that is committed to delivering exceptional data solutions. We are a team of passionate professionals who are dedicated to helping our clients achieve their goals through data-driven insights.The RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team. As a Data...

  • Data Engineer | Data Analyst

    hace 2 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About Ecf Data, LlcEcf Data, Llc is a dynamic and innovative company that is committed to delivering exceptional data solutions. We are a team of passionate professionals who are dedicated to helping our clients achieve their goals through data-driven insights.The RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team. As a Data...

  • Data Engineer | Data Analyst

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It's demanding but extremely...

  • Data Engineer | Data Analyst

    hace 3 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing, developing, and managing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google...

  • Data Engineer | Data Analyst

    hace 3 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing, developing, and managing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google...

  • Data Engineer | Data Analyst

    hace 3 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing and developing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google Cloud...

  • Data Engineer | Data Analyst

    hace 2 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer | Data Analyst to join our team at Ecf Data, LLC. As a key member of our data team, you will be responsible for designing and developing data pipelines, ETL processes, and data warehouses on the Google Cloud platform.Key ResponsibilitiesDesign and develop data pipelines on the Google Cloud...

  • Data Engineer | Data Analyst

    hace 4 días

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy!It's demanding but extremely...

  • Data Engineer

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .This is what you will do:The Data Engineer role is a key member of the Data Team, reporting to the Director of Data Engineering Services, and has close interaction with Functional Leads, Data Architects, Data Analysts and Data Scientists.In this role, the individual will be responsible for designing and overseeing the creation of automated data pipelines,...

  • Data Engineer | Data Analyst

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy!It's demanding but extremely...

  • Data Engineer | Data Analyst

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand : it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion.Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It's demanding but extremely...

  • Data Engineer | Data Analyst

    hace 17 horas

    Barcelona, España Ecf Data, Llc A tiempo completo

    ALOHAS is more than a fashion brand: it's a responsible shopping experience and a chance to participate in the fight against overproduction in fashion. Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It's demanding but extremely...

  • Data Engineer

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    This is what you will do:The Data Engineer role is a key member of the Data Team, reporting to the Director of Data Engineering Services, and has close interaction with Functional Leads, Data Architects, Data Analysts and Data Scientists.In this role, the individual will be responsible for designing and overseeing the creation of automated data pipelines,...

  • Data Engineer

    hace 17 horas

    Barcelona, España Ecf Data, Llc A tiempo completo

    This is what you will do: The Data Engineer role is a key member of the Data Team, reporting to the Director of Data Engineering Services, and has close interaction with Functional Leads, Data Architects, Data Analysts and Data Scientists.In this role, the individual will be responsible for designing and overseeing the creation of automated data pipelines,...

  • Principal Data Engineer

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .Introduction to Role:Join us at AstraZeneca's Alexion as a Principal Data Engineer, a key member of the Data Team. This role offers the opportunity to design and oversee the creation of automated data pipelines, implement best practices for data analytics, supervise data model solutions, and offer strategic insights based on data queries. If you are...

  • Principal Data Engineer

    hace 3 semanas

    Barcelona, España Ecf Data, Llc A tiempo completo

    .Introduction to Role:Join us at AstraZeneca's Alexion as a Principal Data Engineer, a key member of the Data Team. This role offers the opportunity to design and oversee the creation of automated data pipelines, implement best practices for data analytics, supervise data model solutions, and offer strategic insights based on data queries. If you are...

  • Data Engineer

    hace 2 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Ecf Data, LLC. As a key member of our Data Team, you will play a critical role in designing and overseeing the creation of automated data pipelines, implementing best practices for data analytics, and supervising data model solutions.Key ResponsibilitiesDesign and Develop Data...

  • Data Engineer

    hace 2 días

    Barcelona, Barcelona, España Ecf Data, Llc A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Ecf Data, LLC. As a key member of our Data Team, you will play a critical role in designing and overseeing the creation of automated data pipelines, implementing best practices for data analytics, and supervising data model solutions.Key ResponsibilitiesDesign and Develop Data...