Senior Big Data Software Engineer

DescriptionDo you have a sofware engineering background and strong knowledge in Big Data? Are you an open‑minded professional with good English skills? If it sounds like you, this could be the perfect opportunity to join EPAM as a Senior Big Data Engineer.Our teams work in highly agile working environments for Fortune clients, following XP practices and best CI/CD practices. We are looking for a Senior Big Data Engineer with open‑minded personality, who can join our friendly environment and become a core contributor to our team of experts.What You’ll DoDevelop and implement innovative analytical solutions using Cloud Native, Big Data, and NoSQL related technologiesDevelop and implement Cloud/On‑Premise/Hybrid solutions using best in the class data frameworksWork with product and engineering teams to understand requirements, evaluate new features and architecture to help drive decisionsBuild collaborative partnerships with architects, technical leads and key individuals within other functional groupsPerform detailed analysis of business problems and technical environments and use this in designing quality technical solutionActively participate in code review and test solutions to ensure it meets best practice specificationsBuild and foster a high performance engineering culture, mentor team members and provide team with the tools and motivationWrite project documentationWhat You HaveCoding experience with one of the following programming languages: Python/Java/ScalaExperience with Linux OS: configure services and write basic shell scripts, understanding of network fundamentalsGood knowledge of SQL and relational algebraAdvanced experience in software development with Data technologies (e.g. administration, configuration management, monitoring, debugging and performance tuning)Engineering experience and practice in Data Management, Data Storage, Data Visualization, Disaster Recovery, Integration, Operation, SecurityExperience building data ingestion pipelines, Data Warehouse or Database architectureExperience with data modeling; hands‑on development experience with modern Big Data componentsCloud: experience in designing, deploying and administering scalable, available and fault tolerant systemsGood understanding of CI/CD principles and best practicesAnalytical approach to problem; excellent interpersonal, mentoring and communication skillsData‑oriented personality and possessing compliance awareness, such as PI, GDPR, HIPAAMotivated, independent, efficient and able work under pressure with a solid sense for setting prioritiesAbility to work in a fast‑paced (startup like) agile development environmentExperience in high load and IoT Data Platform architectures and infrastructuresVast experience with Containers and Resource Management systems: Docker and KubernetesExperience in direct customer communicationsSolid skills in infrastructure troubleshooting, support and practical experience in performance tuning and optimization, bottleneck problem analysisExperienced in different business domainsEnglish proficiencyAdvanced understanding of distributed computing principlesTechnologiesPython/Java/Scala/Kotlin and SQLCloud‑Native stack: Databricks, Azure DataFactory, AWS Glue, AWS EMR, Athena, GCP DataProc, GCP DataFlowBig Data stack: Spark Core, Spark SQL, Spark ML, Kafka, Kafka Connect, Airflow, Nifi, StreamsetNoSQL: CosmosDB, DynamoDB, Cassandra, HBase; MongoDBQueues and Stream processing: Kafka Streams; Flink; Spark StreamingData Visualization: Tableau, PowerBI, LookerOperation: Cluster operation, Cluster planningElasticsearch/ELKSolid Cloud experience with one of the leading cloud providers (AWS/Azure/GCP): Storage; Compute; Networking; Identity and Security; NoSQL; RDBMS and Cubes; Big Data Processing; Queues and Stream Processing; Serverless; Data Analysis and Visualization; ML as a service (SageMaker; Tensorflow)Enterprise Design Patterns (Secure Inversion of Control etc)Development Methods (TDD, BDD, DDD)Version Control Systems (Git)Testing: Component/ Integration Testing, Unit testing (JUnit)Deep understanding of SQL queries, joins, stored procedures, relational schemas, and SQL optimizationExperience in various messaging systems, such as Kafka, RabbitMQ, Event Hub, Pub/SubRest, Thrift, GRPCBuild Systems: Maven, SBT, Ant, GradleDocker, KubernetesWe OfferWORK & LIFE BALANCE. Enjoy more of your personal time with flexible & remote work options, 24 working days of annual leave and paid time off for numerous public holidaysCONTINUOUS LEARNING CULTURE. Develop your hard & soft skills with internal training and mentorship opportunities, sponsored professional certification, and access to 18,+ LinkedIn coursesCLEAR & DIFFERENT CAREER PATHS. Grow in engineering or managerial direction to become a People Manager, in-depth technical specialist, Solution Architect, or Project/Delivery ManagerGLOBAL RELOCATION OPPORTUNITIES. EPAM has presence in more than 50 countries globally. Explore opportunities to relocate to a new country, and EPAM will provide relocation support for you and your familyCOMPETITIVE BENEFITS. Benefit from a competitive salary, private health insurance, employee stock purchase plan, special discount programs, plus, internal wellbeing programs to take your career to the next levelSTRONG PROFESSIONAL COMMUNITY. Join a global EPAM community of highly skilled experts and connect with them to solve challenges, exchange ideas, share expertise and make friendsAbout EPAMEPAM is a leading digital transformation services and product engineering company with over 53, EPAMers in more than 55 countries and regions . Since , our multidisciplinary teams have been helping make the future real for our clients and communities around the world. In , we opened an office in Spain that quickly grew to over 1, EPAMers distributed between the offices in Málaga and Madrid as well as remotely across the country . Here you will collaborate with multinational teams, contribute to numerous innovative projects, and have an opportunity to learn and grow continuouslyAdditional#DA_SP#J-18808-Ljbffr