Data Engineer

hace 2 semanas

Marbella, España Marbill A tiempo completo

We are looking for a Data Engineer/Developer to join our growing team of analytics experts.

The Data Engineer will support our data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.

Responsible for expanding and optimizing our data and data pipeline architecture, optimizing data flow and collection for cross functional teams.

**Responsibilities**:

- Create and maintain optimal data pipeline architecture,
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Work with stakeholders including the Executive, Product and Dev teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across national boundaries through multiple data centers and AWS regions.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.

**Qualifications**:

- Experience with object-oriented/object function scripting languages like Python, any other language would be a plus.
- Experience with relational SQL and NoSQL databases, including MySQL, SQL Server, (Redshift will be a plus).
- Experience with AWS cloud services: EC2, EMR, RDS.
- Experience in any stream-processing system: Hadoop, Spark, Kafka, etc.
- 3+ y. experience in Python Data-oriented development: Pipelines, streaming, Event Bus (RabbitMQ), REST APIs, Dashboards, and Data recollection.
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Experience in deploying Data Science scripts in production environments
- Build processes supporting data transformation, data structures, metadata, dependency and workload management in Airflow
- A successful history of manipulating, processing and extracting value from disconnected datasets
- Experience supporting and working with cross-functional teams in a dynamic environment.
- Experience with object-oriented/object function scripting languages like Python, any other language would be a plus.
- Experience with relational SQL and NoSQL databases, including MySQL, SQL Server, (Redshift will be a plus).
- Experience with Data Warehouses and Data Lakes
- Experience with AWS cloud services: EC2, EMR, RDS, SageMaker, S3, Airflow
- Experience in any stream-processing system: Hadoop, Spark, Kafka, etc.

  • Data Engineer

    hace 3 semanas

    Marbella, España Sommet Education A tiempo completo

    **Data Engineer** **Permanent contract **/ Lausanne, Switzerland Sommet Education is a hospitality management and pastry & culinary arts education group of more than 1200 employees that is home to five leading brands: Glion Institute of Higher Education, Les Roches Global Hospitality Education, Ecole Ducasse, Invictus Group and the Indian School of...

  • Data Engineer

    hace 1 semana

    Marbella, España Signify Technology A tiempo completo

    **Locations**: - Marbella, Málaga, Spain **Type**: - Permanent **Workplace**: - Remote **Published**: - February 2, 2024 **Contact**: - Harvey Cheadle **Ref**: - 8398 **Required Skills**: AWS,Big Data,Spark,Kafka,PostgreSQL **Role: Data Engineer** **Location: Spain (remote)** **Job Type: Permanent** **Salary: €70,000 - €75,000** Signify...

  • Data Engineer Jr

    hace 2 semanas

    Marbella, Málaga, España Akuaro Work SLU A tiempo completo

    ¿Eres un Data Engineer en el comienzo de tu carrera? ¿Te gustaría tener la oportunidad de crecer en el rol?Entonces esta oportunidad es para vosNuestro partner es una escuela internacional de dirección hotelera y turismo. Cuentan con programas de grado, postgrado y masters en dirección hotelera o turismo de lujo. Además se distinguen por la alta...

  • Data Engineer

    hace 3 semanas

    Marbella, España Marbill A tiempo completo

    **Key Responsibilities** - Debug Airflow tasks to ensure smooth and reliable data pipeline operations. - Write efficient Python code for various data engineering tasks. - Work with relational databases and maintain a strong understanding of SQL. - Use Git commands for version control and collaboration on projects. - Handle deployments and work with Jupyter...

  • Data Engineer

    hace 1 mes

    Marbella, España Ravenpack A tiempo completo

    About us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Data Engineer

    hace 4 semanas

    Marbella, España Ravenpack A tiempo completo

    About us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Data Engineer

    hace 2 semanas

    Marbella, Málaga, España Ravenpack A tiempo completo

    About us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Senior Data Engineer

    hace 5 días

    Marbella, España Ravenpack A tiempo completo

    .About usRavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Data Engineer

    hace 2 semanas

    Marbella, Málaga, España Marbill A tiempo completo

    Key Responsibilities Debug Airflow tasks to ensure smooth and reliable data pipeline operations. Write efficient Python code for various data engineering tasks. Work with relational databases and maintain a strong understanding of SQL. Use Git commands for version control and collaboration on projects. Handle deployments and work with Jupyter Notebooks for...

  • Senior Data Engineer

    hace 1 mes

    Marbella, España Ravenpack A tiempo completo

    About us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Senior Data Engineer

    hace 4 semanas

    Marbella, España Ravenpack A tiempo completo

    About us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Data Engineer Data Science · Marbella · Hybrid Remote

    hace 19 horas

    Marbella, España Ravenpack A tiempo completo

    About usRavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Senior Data Engineer

    hace 1 semana

    Marbella, Málaga, España Ravenpack A tiempo completo

    About the CompanyRavenPack specializes in big data analytics for financial services, catering to professionals who depend on its swift and accurate analysis of vast amounts of unstructured content. The company's products empower clients to boost returns, minimize risks, and enhance efficiency by systematically integrating the impact of public information...

  • Machine Learning Engineer

    hace 4 semanas

    Marbella, España Understanding Recruitment A tiempo completo

    LN.fin_1690906859 **Posted: 01/08/2023** **€70000 - €80000 per annum** *** **Marbella, Málaga** *** **Permanent** *** **Machine Learning Engineer** - FinTech **Marbella, Spain** **Up to €80k** This FinTech in Marbella seeks a talented Machine Learning Engineer to join their rapidly growing team! Processing vast amounts of information per...

  • Machine Learning Engineer

    hace 4 semanas

    Marbella, España Understanding Recruitment A tiempo completo

    LN.fin_1690906859 **Posted: 01/08/2023** **€70000 - €80000 per annum** *** **Marbella, Málaga** *** **Permanent** *** **Machine Learning Engineer** - FinTech **Marbella, Spain** **Up to €80k** This FinTech in Marbella seeks a talented Machine Learning Engineer to join their rapidly growing team! Processing vast amounts of information per...

  • Machine Learning Engineer

    hace 1 semana

    Marbella, Málaga, España Understanding Recruitment A tiempo completo

    LN.fin_ Posted: 01/08/2023€ €80000 per annum***Marbella, Málaga***Permanent***Machine Learning Engineer - FinTechMarbella, SpainUp to €80kThis FinTech in Marbella seeks a talented Machine Learning Engineer to join their rapidly growing teamProcessing vast amounts of information per second, and using AI for efficient data collation, this is an...

  • Backend Engineer

    hace 4 días

    Marbella, España Ravenpack A tiempo completo

    .About UsRavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Backend Engineer

    hace 1 semana

    Marbella, Málaga, España Ravenpack A tiempo completo

    About Us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Backend Engineer

    hace 1 mes

    Marbella, España Ravenpack A tiempo completo

    About Us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...

  • Backend Engineer

    hace 2 semanas

    Marbella, España Ravenpack A tiempo completo

    About Us RavenPack is the leading big data analytics provider for financial services. Financial professionals rely on RavenPack for its speed and accuracy in analyzing large amounts of unstructured content. RavenPack's products allow clients to enhance returns, reduce risk, and increase efficiency by systematically incorporating the effects of public...