Software Engineer | Product Data
hace 4 días
Yapily is on a mission to enable innovative companies to create better and fairer financial services for everyone, through the power of open banking. Yapily is an open banking infrastructure platform solving a fundamental problem in financial services today: access. Historically, card networks have monopolised the global movement of money, and banks have monopolised the ownership of, and access to, financial data. Yapily was founded to challenge these structures and create a global open economy that works for everyone. We exist behind the scenes, securely connecting companies - from growth to enterprise - to thousands of banks worldwide, enabling them to access data and initiate payments through the power of open banking. As a Java Software Engineer specializing in Data Products at Yapily, you will play a key role in designing and implementing our modern next generation data platform. Your responsibilities will involve creating high-performance data pipelines, billing infrastructure, and self-serve data infrastructure and APIs. Ultimately, you will develop data systems that enable engineering teams to derive more value from their data. This is an excellent opportunity to enhance your data engineering skills using the GCP stack. As a Software Engineer, Data Products you will be responsible for: Developing and Optimising Data Pipelines: Designing, building, and maintaining scalable data ingestion and processing systems to transform raw data into actionable insights. Designing and Maintaining Data Products: Developing and maintaining APIs that deliver a seamless data experience for internal and external stakeholders. Managing Databases: Working with SQL and NoSQL databases, optimising schema design, and troubleshooting queries to support high-volume data transactions and improve database performance. Managing Cloud Data Resources: Develop and maintain software products utilising GCP services such as PubSub, BigQuery, Cloud Storage, and Dataflow. Contributing to Billing Infrastructure: Building and maintaining a reliable billing architecture within an event-driven environment. Partnering with Business Intelligence, infrastructure, product managers, and cross-functional teams to deliver data-centric solutions that drive business value. Ensuring Quality Assurance: Implementing testing, monitoring, and logging practices to ensure the performance and resilience of data systems. Participating in code reviews, iterative development, and agile methodologies to enhance product functionality and reliability. Java Development: 3–5 years of hands-on experience in Java development, particularly in data-intensive environments and building data products. Database Management: Background in managing both SQL and NoSQL databases. Version Control & CI/CD: Knowledge of version control (Git) and CI/CD practices for data pipeline deployment and Exposure to tools such as Terraform. Data Modelling & Schema Design: Familiarity with data modelling and schema design for operational or analytical systems. PubSub, Kafka, Flink, Spark Streaming). BI Tools & Visualisation Platforms: Experience supporting BI tools or visualization platforms (e.g. Looker, Grafana, PowerBI etc.). Data Pipelines & APIs: Experience in building and maintaining both batch and streaming data pipelines and APIs. ETL/ELT Processes: Exposure to ETL/ELT processes in medium-to-large scale data environments (experience handling millions of records/events daily is a plus). Python: Knowledge for data automation and scripting. Familiarity with tools like Docker and Kubernetes. Airflow, Dagster, Prefect). Cloud-based Data Services: Exposure to cloud-based data services (GCP preferred; AWS/Azure also considered). Data Lineage & Metadata Management: Data Governance & Compliance: Awareness of data governance and compliance principles (GDPR, ISO27001). Background in SaaS / API-driven environments, ideally with experience in billing or usage-based data. Data Pipeline Monitoring & Troubleshooting: Basic skills in monitoring and troubleshooting data pipelines. Data Security: Understanding of data security best practices and encryption for sensitive data. Data Quality: Experience ensuring data quality through validation, cleaning, and monitoring. You love innovation – it’s wired into your DNA. You understand the importance of attention to detail and ensuring quality outputs. Everything you produce is of high quality. 23 days holiday a year (plus
-
Software Engineer | Product Data
hace 6 días
Málaga, España Yapily A tiempo completoHistorically, card networks have monopolised the global movement of money, and banks have monopolised the ownership of, and access to, financial data. Yapily was founded to challenge these structures and create a global open economy that works for everyone. We exist behind the scenes, securely connecting companies - from growth to enterprise - to thousands...
-
Lead Data Software Engineer
hace 1 semana
Málaga, España EPAM Systems A tiempo completoLead Data Software Engineer (Databricks)Siga leyendo para comprender completamente lo que este trabajo requiere en cuanto a habilidades y experiencia. Si su perfil encaja, presente su candidatura.Join to apply for theLead Data Software Engineer (Databricks)role atEPAM SystemsLead Data Software Engineer (Databricks)2 days ago Be among the first 25...
-
Senior Data Software Engineer
hace 1 semana
Málaga, España EPAM Systems A tiempo completoSenior Data Software Engineer (Databricks) We are seeking a Senior Data Software Engineer skilled in Databricks to join our team.Responsibilities Design, develop, and maintain scalable data pipelines and architecturesOptimize data models and enhance ETL processes utilizing Databricks and related technologiesImplement rigorous data quality checks and...
-
Lead Data Software Engineer
hace 1 semana
Málaga, España EPAM Systems A tiempo completoLead Data Software Engineer (Spark/Scala/Databricks)Compruebe a continuación si tiene lo necesario para esta oportunidad y, si es así, envíe su solicitud lo antes posible.Join to apply for theLead Data Software Engineer (Spark/Scala/Databricks)role atEPAM SystemsLead Data Software Engineer (Spark/Scala/Databricks)1 day ago Be among the first 25...
-
Lead Data Software Engineer
hace 6 días
Málaga, España EPAM Systems A tiempo completoLead Data Software Engineer (Databricks) Join to apply for the Lead Data Software Engineer (Databricks) role at EPAM Systems We are looking for a Lead Data Software Engineer with experience and knowledge in Databricks and an open-minded personality, who can join our friendly environment and become a core contributor to our team of experts. Do you have...
-
Lead Data Software Engineer
hace 1 semana
Málaga, España EPAM Systems A tiempo completoLead Data Software Engineer (Spark/Scala/Databricks) Join to apply for the Lead Data Software Engineer (Spark/Scala/Databricks) role at EPAM Systems Lead Data Software Engineer (Spark/Scala/Databricks) 1 day ago Be among the first 25 applicants Join to apply for the Lead Data Software Engineer (Spark/Scala/Databricks) role at EPAM Systems Are you an...
-
Lead Data Software Engineer
hace 6 días
Málaga, España EPAM Systems A tiempo completoLead Data Software Engineer (Databricks)Join to apply for the Lead Data Software Engineer (Databricks) role at EPAM SystemsWe are looking for a Lead Data Software Engineer with experience and knowledge in Databricks and an open-minded personality, who can join our friendly environment and become a core contributor to our team of experts.Do you have...
-
Lead Data Engineer with English
hace 1 semana
Málaga, España EPAM Systems A tiempo completoLead Data Software Engineer (Spark/Scala/Databricks) Join to apply for the Lead Data Software Engineer (Spark/Scala/Databricks) role at EPAM Systems Lead Data Software Engineer (Spark/Scala/Databricks)1 day ago Be among the first 25 applicants Join to apply for the Lead Data Software Engineer (Spark/Scala/Databricks) role at EPAM Systems Are you an...
-
Senior Big Data Engineer
hace 2 días
Málaga, España Grid Dynamics A tiempo completoJoin to apply for the Senior Big Data Engineer role at Grid Dynamics 1 day ago Be among the first 25 applicants Join to apply for the Senior Big Data Engineer role at Grid Dynamics About The ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and...
-
Senior Data Software Engineer
hace 1 semana
málaga, España EPAM Systems A tiempo completoSenior Data Software Engineer (AWS/Databricks/PySpark) EPAM Systems is seeking a Senior Data Software Engineer with hands-on experience in Databricks or similar ETL tools. This role involves migrating data product pipelines from Oracle workloads to Databricks, working in Madrid, Málaga, or remotely across Spain. You will join a dynamic, agile team servicing...