Senior Big Data Engineer

Join to apply for the Senior Big Data Engineer role at Grid Dynamics1 day ago Be among the first 25 applicantsJoin to apply for the Senior Big Data Engineer role at Grid DynamicsAbout The ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets.Location: Remote from SpainEmployment Type: Full-Time ContractorAbout The ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets.About The RoleWe’re looking for a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team that owns infrastructure critical to analytics, modeling, and media performance reporting.ResponsibilitiesDesign and develop large-scale data pipelines and infrastructure to process high-volume datasetsBuild and maintain scalable, production-grade ETL/ELT workflows using Apache Spark, Scala, and SQLWork with distributed file systems (HDFS) and optimize data processing performanceWrite and test reusable and reliable code using functional programming libraries like Cats and fs2Develop and test solutions in containerized environments (e.g., Docker, Kubernetes)Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutionsTake ownership of services with minimal supervision, demonstrating initiative and autonomyRequirementsStrong programming experience with Scala and distributed data frameworks like Apache SparkProficiency in SQL and experience handling large datasets in HDFS environmentsWorking knowledge of Python for scripting and data manipulation tasksHands-on experience developing and testing in Docker and/or Kubernetes environmentsFamiliarity with Cats, fs2, or other advanced Scala functional programming librariesAbility to work autonomously in a dynamic, fast-paced environment and take full ownership of projectsWe offerOpportunity to work on bleeding-edge projectsWork with a highly motivated and dedicated teamCompetitive salaryFlexible scheduleProfessional development opportunitiesAbout UsGrid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeContractJob functionJob functionEngineering and Information TechnologyIndustriesIT Services and IT ConsultingReferrals increase your chances of interviewing at Grid Dynamics by 2xSign in to set job alerts for “Big Data Developer” roles.Junior Software Engineer - Cross-platform C++ - MultipassFreelance Software Developer (C/C++ - Rust) - AI TrainerSenior Software Engineer - Age of Empires (Remote)Senior Frontend Developer (React) - Web WalletFreelance Software Developer (Golang) - AI TranerSoftware Engineer (Python/Linux/Packaging)Front Developer JS/WebComponents/ LitElementFreelance Software Developer (Rust) - AI TrainerGraduate Software Engineer, Open Source and Linux, Canonical UbuntuSoftware Engineer - Cross-platform C++ - MultipassSoftware Engineer - Python - Container ImagesWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr