Senior Data Engineer
hace 6 días
We are currently seeking a Senior Data Engineer with 5-7 years of experience. The ideal candidate will have the ability to work independently within an AGILE working environment and experience working with cloud infrastructure leveraging tools such as Apache Airflow, Databricks, DBT, and Snowflake. Familiarity with real-time data processing and AI implementation, including generative AI, is highly advantageous.Responsibilities:Design, build, and maintain scalable and robust data pipelines to support analytics and machine learning models, ensuring high data quality and reliability for both batch & real-time use cases.Design, maintain, and optimize data models and data structures in tools such as Snowflake and Databricks.Leverage Databricks and Cloud-native solutions for big data processing, ensuring efficient management of Spark jobs and seamless integration with other data services.Utilize PySpark and/or Ray to build and scale distributed computing tasks, enhancing the performance of machine learning model training and inference processes.Monitor, troubleshoot, and resolve issues within data pipelines and infrastructure, implementing best practices for data engineering and continuous improvement.Integrate generative AI capabilities into data pipelines and workflows to support advanced use cases such as data enrichment, automated content generation, and natural language processing.Collaborate with machine learning engineers to optimize generative AI workflows, ensuring seamless deployment and scalability in production environments.Develop APIs and tools to enable internal teams to consume generative AI models and services efficiently.Stay informed about advancements in generative AI technologies and recommend their adoption to improve business processes and analytics capabilities.Diagrammatically document data engineering workflows and generative AI integrations.Collaborate with other Data Engineers, Product Owners, Software Developers, and Machine Learning Engineers to implement new product features by understanding their needs and delivering on time.Qualifications:Minimum of 5 years of experience deploying enterprise-level scalable data engineering solutions.Strong examples of independently developed data pipelines end-to-end, from problem formulation, raw data, to implementation, optimization, and results.Proven track record of building and managing scalable cloud-based infrastructure on AWS (incl. S3, Dynamo DB, EMR).Experience implementing and managing AI model lifecycles in production, including generative AI models.Familiarity with tools like OpenAI API, Hugging Face Transformers, or equivalent platforms for generative AI.Strong experience using Apache Airflow (or equivalent), Snowflake, and Lucene-based search engines.Advanced SQL and Python knowledge with associated coding experience.Experience with Databricks (Delta format, Unity Catalog).Strong experience with DevOps practices for continuous integration and continuous delivery (CI/CD).Experience wrangling structured & unstructured file formats (Parquet, CSV, JSON).Understanding and implementation of best practices within ETL and ELT processes.Data quality best practice implementation using tools like Great Expectations.Real-time data processing experience using Apache Kafka (or equivalent) is advantageous.Knowledge of generative AI model architectures and their integration into scalable systems.Proven ability to work independently with minimal supervision.Takes initiative and is action-focused.Mentors and shares knowledge with junior team members.Strong ability to collaborate within cross-functional teams.Excellent communication skills with the ability to communicate with stakeholders across varying interest groups.Fluency in spoken and written English.
#J-18808-Ljbffr
-
Senior Data Engineer
hace 2 semanas
España Data Science Festival A tiempo completoJoining one of the best-known retail brands in the UK as a Senior Data Engineer, you will support the delivery of data transformation during an exciting time within the company. They are looking for someone with experience in building and maintaining data pipelines and to collaborate with the wider data teams.The OpportunityFor this role as Senior Data...
-
Senior Data Engineer
hace 2 semanas
España buscojobs España A tiempo completoSenior ML Data EngineerBarcelona, Catalonia Dow Jones & Company, Inc. HoyAbout Our Organization: Dow Jones is a global provider of news and business information, delivering content to consumers and organizations around the world across multiple formats, including print...Senior Data Engineer Id20476Barcelona, Catalonia buscojobs España HoyThis is a remote...
-
Senior Data Engineer Madrid · Híbrido
hace 4 semanas
España Tecdata Engineering A tiempo completoOferta de Empleo: Senior Data EngineerUbicación: Madrid, con disponibilidad de acudir 2 días a la semana Descripción del perfil: Buscamos un Senior Data Engineer con una experiencia sólida en ingeniería de datos y conocimientos en herramientas modernas de infraestructura y desarrollo de datos. El candidato ideal debe contar con una fuerte capacidad...
-
Senior Data Engineer Madrid · Híbrido
hace 4 semanas
España Tecdata Engineering A tiempo completoOferta de Empleo: Senior Data EngineerUbicación: Madrid, con disponibilidad de acudir 2 días a la semanaDescripción del perfil: Buscamos un Senior Data Engineer con una experiencia sólida en ingeniería de datos y conocimientos en herramientas modernas de infraestructura y desarrollo de datos. El candidato ideal debe contar con una fuerte capacidad...
-
Senior Data Engineer
hace 1 mes
España Civitatis A tiempo completo¿Te apasionan los viajes, la cultura y el ocio y tienes ganas de participar en el crecimiento de la empresa Nº 1 en servicios turísticos en español?Nuestro equipo no para de crecer y buscamos personas con talento e ilusión por desarrollarse. Somos un equipo joven, multicultural e innovador que entiende cada día como un desafío y una nueva oportunidad...
-
Data Engineer Senior
hace 1 mes
España Sgtech A tiempo completoDesde Sg tech buscamos incorporar un perfil Data Engineer Senior para integrarse en un proyecto de Ingeniería de Proceso de Datos (Business Intelligence).Perfil de Data Engineer Senior con experiencia en:Migración de datos y proyectos de migración ( data form, cloud function, cloud run, dataflow )Amplia experiencia en Google Cloud PlatformConocimientos en...
-
Verisk Analytics Data Engineer III
hace 1 mes
España Data Engineer Jobs A tiempo completoWe help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable.Job DescriptionHYBRID - ON SITE - MUST BE OK WITH COMING INTO THE JERSEY CITY, NJ OFFICEThe Data Warehouse Dimensional Modeler is a...
-
Senior Data Engineer
hace 2 semanas
España MALTHUS DARWIN A tiempo completoMalthus Darwin es una empresa de Consultoría, especializada en la búsqueda, selección y evaluación de perfiles IT. Nuestro principal objetivo es proporcionar los mejores recursos humanos a nuestros clientes con la mayor rapidez y la máxima eficacia ofreciendo siempre un servicio de calidad. Actualmente estamos en búsqueda de un/a senior Data Engineer,...
-
Senior Data Engineer
hace 3 horas
España A-SAFE Digital A tiempo completoRole OverviewAs a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and...
-
Senior Data Engineer
hace 2 semanas
España A-SAFE Inc. A tiempo completoAs a Senior Data Engineer within our Data Analytics Team, you will play a main reference role in managing and optimizing our data infrastructure and processes to ensure the efficient flow of data and information for critical business insights.If you're a highly skilled and motivated Data Engineer who is passionate about data quality and efficiency, we...
-
Senior Data Engineer
hace 1 mes
España Logicalis Spain A tiempo completoEn Logicalis Spain estamos buscando a un perfil de Data Engineer con conocimientos de modelos de datos analíticos (en estrella), SQL y Python para el área de Data & Analytics y para el área de Data de uno de nuestros principales clientes del sector seguros. Requisitos Funcionales Buscamos a un/a ingeniero/a de datos senior. Requisitos...
-
Senior Data Engineer
hace 1 mes
España Logicalis Spain A tiempo completoEn Logicalis Spain estamos buscando a un perfil de Data Engineer, con conocimientos de modelos de datos analíticos (en estrella), SQL y Phyton para el área de Data & Analytics y para el área de Data de uno de nuestros principales clientes del sector seguros. Requisitos Funcionales Buscamos a un/a ingeniero/a de datos senior. Requisitos Técnicos: -...
-
Senior Data Engineer
hace 1 mes
España Visium SA A tiempo completoTitle: Senior Data EngineerType: Full-timeLocation: ValenciaStart date: March 2024About usAt Visium, we enable enterprise executives in defining their AI & Data strategy, execute large scale transformations and implement AI across operations, ensuring their organization becomes future-proof.With expertise in strategy, architecture, cloud engineering,...
-
Data Engineer Senior
hace 3 semanas
España Venecia IT HeadHunter A tiempo completoEstimada red, en Venecia IT HeadHunter nos encontramos en búsqueda de un Ingeniero en informática o carrera a fin, para desempeñar el cargo de ¨Data Engineer Senior, modalidad 100% REMOTO (Palma de Mallorca): **Skills**: - Ingeniero de sistemas o carrera a fin - Conocimiento Avanzado y experiência mínima de 3 años en SQL - Experiência mínima de 2...
-
Senior Data Engineer
hace 2 semanas
España buscojobs España A tiempo completoJoin our team. From Plexus Tech, we need to incorporate a Senior Data Engineer in Microsoft environment.REQUIREMENTS:Microsoft technology (Integration Services, Analysis Services, Reporting Services).Knowledge of Power BI and Azure data technologies (Azure Synapse...) is an asset.Advanced English is a MUST.Additional Information:With our hybrid model,...
-
Senior Data Engineer
hace 1 mes
España The Knot Worldwide A tiempo completoABOUT THE ROLE AND OUR TEAM: The Knot Worldwide’s Data team is looking for a highly motivated, highly energetic team-player with a strong analytical mindset to join as a Senior Data Engineer supporting end-to-end data pipelines for our business. This role will be partnering closely with our stakeholders and also with other Data teams to develop data models...
-
Senior Data Engineer
hace 4 semanas
España Plexus A tiempo completoJoin our team. From Plexus Tech, we need to incorporate a Senior Data Engineer in Microsoft environment. REQUIREMENTS: Microsoft technology (Integration Services, Analysis Services, Reporting Services). Knowledge of Power BI and Azure data technologies (Azure Synapse...) is an asset. Advanced English is a MUST. With our hybrid model, Flexology, you can...
-
Senior Data Engineer
hace 1 mes
España Playvalve A tiempo completoAbout the CompanyPlayvalve is a vibrant fast-growing gaming studio with an eye on the future. Our mission is to build fun and relaxing games meant to last, and we do that by bringing together a team of experts who love what they do. Our talented designers, artists, engineers, marketeers and analysts have created several games delivering joy and entertainment...
-
Data Engineer | Data Analyst
hace 1 mes
España Data Privacy A tiempo completoALOHAS is more than a fashion brand: it’s a responsible shopping experience and a chance to participate in the fight against overproduction in fashion. Working at ALOHAS is being part of the innovation and growth of a Spanish start-up with a young, creative and proactive team, good communication and a high level of energy! It’s demanding but extremely...
-
Senior Data Engineer
hace 1 mes
España The Knot Worldwide Inc. A tiempo completoHere at The Knot Worldwide, we believe in doing work that matters. In more than 16 countries around the world, The Knot Worldwide’s leading family of brands—including The Knot, WeddingWire, Bodas, The Bash, The Bump, and more—help people take celebration planning from inspiration to action. When you join our global team, you’ll be a part of a diverse...
