Data Engineer

hace 2 semanas


Barcelona, España Antal International Network A tiempo completo

Our client is the best technological consultant company, specialist in Microsoft, as well as Dynamics 365 FO, Dynamics 365, AX, Power BI, CRM, EPR, Office 365 and Azure. With offices in Madrid, Barcelona, Valencia and Castellon with specialized professional experts, the company has aided in the development of small businesses through automatization and implantation of Microsoft solutions.
THE ROLE As a Data Engineer/Big Data Developer you will develop and enhance data systems and pipelines, support the process of optimization in extraction, transformation and loading of large data sets, and design solutions with strategic focus on code quality, reliability, reusability, maintainability and dataops, all of which will have an immediate impact on the day-to-day functioning of the company.
Data reporting and visualization to support business operations and decisions.Design data structures and write code to combine and transform datasets to meet business needs.Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologiesPerform statistical analyses on a wide range of datasets.Convert SAS based pipelines into languages like PySpark, Scala to execute on Hadoop and non-Hadoop ecosystemsBuild new datasets proactively; seek out, develop, and share new algorithms and best practices.Build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python and SQL (Snowflake & SQL Server) in both on premise and cloud environmentsManage and improve the user facing server infrastructure (web + api) including authorization and load balancingWork with Cloud Computing Platforms (GCP/AWS), Luigi, Kafka and other open-source technologiesImplement both batch and streaming workflows that combine, transform and enrich data utilizing Microsoft AzureREQUIREMENTS Bachelor/Master´s in Computer Sc./App or Information TechnologyExperience of more 3+ years in a similar roleDesirable experience on version control (Git), Data Modelling, Data Pipelines, Solution Development, Product Industrialization, CI/CD (Jenkins or Git hub)Experience using analytics programming languages (Python, Spark, Scala, Java…) to manipulate data and draw insights from large data sets.Knowledge in machine learning techniques.Experience in cloud infrastructure such as MS AzureExperience with Spark, SQL, NoSQL, DatabricksKnowledge in distributed systems and frameworks such as Hadoop, HBase, NoSQL. Spark SQL, Spark Streaming, HDFS, Hive.Minimum 2-year experience in: Spark with Scala, SQL, Azure, Power BI, Agile WorkingAbility to work individually without much direction while also working as part of a team towards a common goal.Good written and oral communication skills.Results-oriented, self-directed ability to drive change in an unstructured environment.International experience and multicultural skills are highly valueTravel availability: Yes, 10% maximum of total working timeUpload your resume and our tool will compare it to the requirements for this job like recruiters do.
#J-18808-Ljbffr


  • Data Engineer, Hibrido

    hace 2 semanas


    Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido. Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo. data, Scala, PowerShell,

  • Data Engineer, hibrido

    hace 6 días


    Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo. data, Scala, PowerShell,

  • Data Engineer, hibrido

    hace 2 semanas


    Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo. data, cala, PowerShell, data, cala, PowerShell,

  • Data Engineer, hibrido

    hace 2 semanas


    Barcelona, Barcelona, España Krell Consulting & Training A tiempo completo

    Data Engineer en hibrido.Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell así como en Big Data y desarrollo de software con al menos 7 años de experiencia en el campo.data, cala, PowerShell, data, cala, PowerShell,

  • Data Science Engineer

    hace 4 semanas


    Barcelona, España TEC Partners A tiempo completo

    Job Type: Permanent Sector: Technology Seniority: Junior Essential skils: Data, Python, Software Engineering, Retail, Research, Science Location: Barcelona Region: Catalonia Salary: Negotiable **Data Science Engineer** - Permanent Role - Minimum 2 years - Barcelona Based** TEC Partners is looking for a Data Science Engineer to join my clients Data...

  • Data Engineer

    hace 4 semanas


    Barcelona, España Page Personnel España A tiempo completo

    Maintain and improve the data warehouse, including ETL and ELT processes and autonomous systems in Google Cloud. - Develop data quality processes to ensure the quality of the data. - Understand business needs and requirements and define how to solve them using data solutions. - Define, implement and extract insights from user tests to help other teams make...

  • Data Engineer

    hace 4 días


    Barcelona, España Itjobs A tiempo completo

    At CGI we are looking for a Data Engineer with Palantir.Requirements:- More than 2 years of experience in the architecture of data solutions developed in the cloud.- Palantir Certification- Python/PySpark for Data Engineer- Knowledge of data management fundamentals and data warehousing principles.- Demonstrated strength in data modelling, ETL and...

  • Data Engineer

    hace 1 semana


    Barcelona, España Krell Consulting & Training A tiempo completo

    Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell, así como en Big Data y desarrollo de software, con al menos 7 años de experiencia en el campo.

  • Data Engineer

    hace 1 semana


    Barcelona, Barcelona, España Krell Consulting & Training A tiempo completo

    Estamos seleccionando un Integration Engineer será responsable del desarrollo y mantenimiento de la plataforma Datalake. Se espera que tenga experiencia en Scala y PowerShell, así como en Big Data y desarrollo de software, con al menos 7 años de experiencia en el campo.

  • Data Engineer

    hace 4 semanas


    Barcelona, España Skillsearch Limited A tiempo completo

    Job reference - 13266 - Company Name - Skillsearch Limited - Salary - Location - Barcelona, Spain - Country - Spain - Industry sector - Programming - Job start date - ASAP - Posted date - 17/04/2023 - Experience Level - Not specified - Job type - Permanent | Full Time - Remote / Hybrid - No Do you have data engineering experience, and are you seeking a new...

  • Data Engineer

    hace 7 días


    Barcelona, Barcelona, España OXIGENT Technologies A tiempo completo

    ¿Te interesaría seguir desarrollándote como Ingeniero/a de Data en una empresa líder del sector transportes y turismo en un entorno colaborativo con jerarquía horizontal y con proyección a futuro, ubicada en el Baix Llobregat?Desde Oxigent Technologies seleccionamos un/a DATA ENGINEER para formar parte de un equipo de profesionales cuya misión será...


  • Barcelona, España Cmv Consultores A tiempo completo

    Data Engineer en Barcelona. CMV Consultores es una empresa de Servicios de IT dedicada fundamentalmente a la selección de profesionales con perfiles técnicos. Asimismo ofrece a sus clientes servicios de asesoría y soporte en la implantación de soluciones tecnológicas y desarrollo de aplicaciones. ¿Estás buscando una nueva oportunidad o un nuevo...


  • Barcelona, España CMV Consultores A tiempo completo

    Data Engineer en Barcelona.CMV Consultores es una empresa de Servicios de IT dedicada fundamentalmente a la selección de profesionales con perfiles técnicos. Asimismo ofrece a sus clientes servicios de asesoría y soporte en la implantación de soluciones tecnológicas y desarrollo de aplicaciones.¿Estás buscando una nueva oportunidad o un nuevo...

  • Data Engineer

    hace 4 semanas


    Barcelona, España Experis España A tiempo completo

    Buscamos un Data Engineer para trabajar con contrato indefinido en la plantilla de una firma de consultoría global focalizada exclusivamente en proyectos de **Data & Analytics**, **Funciones**: - Definir y diseñar plataformas de data moderno en nube pública o en nube privada cubriendo todo el ciclo de vida de datos bajo una estrategia dirigida por...

  • Junior DATA Engineer

    hace 1 semana


    Barcelona, Barcelona, España Krell Consulting & Training A tiempo completo

    Junior DATA Engineer (AWS/ SQL/INGLES) en hibrido.En Krell-Consulting estamos en la búsqueda de un Ingeniero de Datos para trabajar en proyecto localizado en Barcelona en modalidad híbrida.PERFIL Data Engineer (AWS/SQL)LOCALIZACIÓN BarcelonaMODALIDAD DE TRABAJO Hibrido 3-2. en clienteFUNCIONES Diseño de soluciones y desarrollo de soluciones técnicas....

  • Data Engineer

    hace 3 semanas


    Barcelona, España Tecnonews A tiempo completo

    IPEG is hiring a data engineer to design and build big data systems for analyzing geospatial data. You will be working directly with economists and researchers leading the lab, in a fast-paced environment. You should:- Be fluent in Python and Scala.- Have loads of experience with Spark or some other Hadoop-based batch analysis systems.- Show knowledge of the...

  • Data Integration Engineer

    hace 2 semanas


    Barcelona, España Hitachi Vantara Corporation A tiempo completo

    Description We are looking for an experienced Data Integration Engineer to join our team. The ideal candidate will have a passion for developing and maintaininghigh-quality data processing and integration solutions using modern technologies.Design, develop, and maintain SQL code.Bring 100k LoC codebase into SDLC (including version control and testing)Ensure...

  • Data Engineer

    hace 6 días


    Barcelona, España Kantox A tiempo completo

    At Kantox we are looking for a Data Engineer to join our Data team to design, improve and enhance our current data architecture. Kantox is a growing organisation with growing data needs, therefore scalable, reliable and efficient data architecture and orchestration of data pipelines are fundamental for our business. This is an exciting full-time job with...

  • Junior Data Engineer

    hace 6 días


    Barcelona, España Kiteris Solutions A tiempo completo

    We are looking for a junior data engineer to join our team. You will use various methods to transform raw data into useful data systems. To succeed in this data engineering position, you should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming...

  • Data Integration Engineer

    hace 2 semanas


    Barcelona, España Hitachi A tiempo completo

    DescriptionWe are looking for an experienced Data Integration Engineer to join our team. The ideal candidate will have a passion for developing and maintaining high-quality data processing and integration solutions using modern technologies.Design, develop, and maintain SQL code. Bring 100k LoC codebase into SDLC (including version control and testing)...