Senior Big Data Engineer

Join to apply for the Senior Big Data Engineer role at Grid Dynamics 1 day ago Be among the first 25 applicants Join to apply for the Senior Big Data Engineer role at Grid Dynamics About The ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets. Location: Remote from SpainEmployment Type: Full-Time ContractorAbout The ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets.About The RoleWe’re looking for a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team that owns infrastructure critical to analytics, modeling, and media performance reporting.ResponsibilitiesDesign and develop large-scale data pipelines and infrastructure to process high-volume datasets Build and maintain scalable, production-grade ETL/ELT workflows using Apache Spark, Scala, and SQL Work with distributed file systems (HDFS) and optimize data processing performance Write and test reusable and reliable code using functional programming libraries like Cats and fs2 Develop and test solutions in containerized environments (e.g., Docker, Kubernetes) Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutions Take ownership of services with minimal supervision, demonstrating initiative and autonomy RequirementsStrong programming experience with Scala and distributed data frameworks like Apache Spark Proficiency in SQL and experience handling large datasets in HDFS environments Working knowledge of Python for scripting and data manipulation tasks Hands-on experience developing and testing in Docker and/or Kubernetes environments Familiarity with Cats, fs2, or other advanced Scala functional programming libraries Ability to work autonomously in a dynamic, fast-paced environment and take full ownership of projects We offerOpportunity to work on bleeding-edge projects Work with a highly motivated and dedicated team Competitive salary Flexible schedule Professional development opportunities About UsGrid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India. Seniority level Seniority level Mid-Senior level Employment type Employment type Contract Job function Job function Engineering and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Grid Dynamics by 2x Sign in to set job alerts for “Big Data Developer” roles. Junior Software Engineer - Cross-platform C++ - Multipass Freelance Software Developer (C/C++ - Rust) - AI Trainer Senior Software Engineer - Age of Empires (Remote) Senior Frontend Developer (React) - Web Wallet Freelance Software Developer (Golang) - AI Traner Software Engineer (Python/Linux/Packaging) Front Developer JS/WebComponents/ LitElement Freelance Software Developer (Rust) - AI Trainer Graduate Software Engineer, Open Source and Linux, Canonical Ubuntu Software Engineer - Cross-platform C++ - Multipass Software Engineer - Python - Container Images We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr