Staff Software Engineer, Storage
hace 2 semanas
Business Area:
Engineering
Seniority Level:
Mid-Senior level
Job Description:
At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world's largest enterprises.
The Data Platform Pillar is the bedrock of Cloudera's technology, where we design and build the core components that let our customers store, manage, and process data with unmatched scalability, security, and performance.
Cloudera is looking for an exceptional and passionate software engineer with a strong distributed systems background to join the
Storage Engineering team focused on building Apache Ozone
. The Storage team is responsible for primary storage and storage access layers, which are core to the platform. They created and wrote most of the HDFS code and made a huge impact on the big data and cloud computing industry. Apache Ozone (Apache Ozone) provides a massively scalable distributed object store with a distributed file system interface. Ozone is designed to scale to tens of billions of files and blocks, and overcome the limitations of Hadoop Distributed File System (HDFS), namely, millions of small files and managing a huge number of datanodes.
Ozone is one of the fastest-growing products inside CDP in terms of customer adoption and expansion revenue.
As a Staff Software Engineer, you will…
- You will be directly involved in the design and implementation of the core feature set of Apache Ozone and Apache Ratis (open-source RAFT implementation)
- You will regularly contribute code and design docs to the Apache open-source community.
- As part of storage engineering, you will support enterprise customers running 100s of petabytes-scale big data analytics and ML/AI pipelines.
- You will partner with product managers and cross-functional teams as a part of the Cloudera Data Platform ecosystem in understanding requirements and turning them into a solid design and implementation, and facilitating integration and adoption.
- You will be responsible for leading and collaborating with a talented group of engineers working on a feature and mentoring junior engineers.
We are excited if you have…
- Bachelor's +6, Master's 4-6 years of relevant industry experience required
- Strong backend engineering skill set with expertise in Java, or strong C++ skills, with intermediate Java expertise
- Passionate about programming. Clean coding habits, attention to detail, and focus on quality
- Experience with large-scale, distributed systems design and development with a strong understanding of scaling, replication, consistency, and high availability
- Solid experience with system software design and development with a strong understanding of computer architecture, storage, network, and IO subsystems, and distributed systems
- Hands-on programmer with strong data structures and algorithms skillset
- Strong oral and written communication skills
You may also have..
- Strong background in a distributed storage system, including file systems, database storage internals, NoSQL storage, or distributed hash tables
- Strong background in performance tuning, identifying performance bottlenecks, and implementing performance optimizations
- Strong understanding of the Apache Big Data ecosystem and over 3+ years of experience in systems software, including file systems
- Recognized contributions to open source projects
- Experience using projects such as Hive, Pig, MapReduce, HBase, etc., is a big plus
- Good Understanding of storage development, RAFT replication framework, or equivalent distributed consensus frameworks
Why this role matters:
You will tackle complex distributed systems challenges, crafting the foundational software for the control and data planes that powers CDP and keeps it running at massive scale. Working at the forefront of hybrid and multi-cloud technology, you will empower data scientists, engineers, and analysts with the tools and infrastructure they need for advanced analytics and modeling.
Collaboration is key, you will work alongside brilliant minds across product, data science, and engineering to drive innovation, standardize best practices, and shape the future of enterprise AI and data platforms. This is your chance to build the future of data and see your work make a global impact.
What you can expect from us:
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
EEO/VEVRAA
-
Senior Staff Engineer
hace 9 horas
Greater Lerida Area, España Cloudera A tiempo completoBusiness Area:EngineeringSeniority Level:Mid-Senior levelJob Description:At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source...
-
Staff Platform Engineer – Taikun Platform Automation
hace 2 semanas
Greater Lerida Area, España Cloudera A tiempo completoBusiness Area:EngineeringSeniority Level:Mid-Senior levelJob Description:At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry. Powered by the relentless innovation of the open source...
-
Energy Storage Battery Design Engineer
hace 2 semanas
Greater Sevilla Metropolitan Area, España Atul Financial Services A tiempo completoCompany DescriptionWe suggest you enter details here.Role DescriptionThis is a full-time hybrid role for an Energy Storage Battery Design Engineer based in the Greater Sevilla Metropolitan Area, with some opportunity to work from home. The engineer will be responsible for designing and optimizing energy storage batteries, conducting research and development...
-
Staff Product Applications Engineer
hace 9 horas
Greater Valencia Metropolitan Area, España Analog Devices A tiempo completoAbout Analog DevicesAnalog Devices, Inc. (NASDAQ: ADI ) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, and software technologies into solutions that help drive advancements in digitized factories, mobility, and digital healthcare, combat climate...
-
Staff Lead Engineer sector tech
hace 2 semanas
Greater Madrid Metropolitan Area, España Connecting Visions A tiempo completoNuestro cliente necesita incorporar a su equipo enplantilla o en formato freelancecon posibilidad de posterior incorporación a estructura un perfil para desempeñar la función deStaff Lead Engineer.Se trata de una empresa consolidada y rentable, con experiencia probada enproductos digitales complejos.Parten de cero en este producto por decisión...
-
Software Engineer
hace 2 semanas
Greater Madrid Metropolitan Area, España Haystack A tiempo completoSoftware Development Engineer II | Madrid, Provincia de Madrid, Spain | HybridWe're working with Expedia on this exciting opportunity. Join the Travel Advisor Affiliate Program (TAAP) team to build services that support Travel Advisors and Partners, and contribute to making travel smoother and more memorable for millions.The Role• Design, develop, test,...
-
Battery Software Engineer
hace 2 semanas
Greater Bilbao Metropolitan Area, España UL Solutions A tiempo completoWe are a dynamic high-tech company from Aachen with subsidiary in Bilbao area, Spain. We deal with all electrochemical energy storage systems. The focus here is on Li-ion technologies and lead-acid batteries, but we also deal with SuperCaps, Ni-based technologies or primary cells are part of our work. The company has specialized in three core areas in the...
-
Senior Software Engineer
hace 2 semanas
Greater Barcelona Metropolitan Area, España NDT Global A tiempo completoAbout NDT GlobalNDT Global is the leading provider of inline diagnostic solutions, advanced data insights, and integrity management services that safeguard energy-sector infrastructure. The company is recognized for its expertise in both ultrasonic inspection technologies — such as Pulse Echo, Pitch-and-Catch, Phased Array, and Acoustic Resonance (ART...
-
Azure Data Engineer
hace 2 semanas
Greater Madrid Metropolitan Area, España Grupo TECDATA Engineering A tiempo completoExperiencia requerida:5+ añosModalidad:90% remotoHorario:09:00 – 18:00Idioma:Inglés C1Salario:57k Responsabilidades principalesDiseño y construcción de ETL Data Pipelines usando Python, Scala y PySpark.Implementación y mantenimiento de pipelines desde sistemas core banking y fuentes externas.Mejoras de calidad de datos, monitorización y...
-
NodeJS AI Software Engineer
hace 2 semanas
Greater Barcelona Metropolitan Area, España Capitole A tiempo completoBuscamos Software Engineer / TypeScript (IA & Cloud)Ubicación:Alrededores de Barcelona – modalidad híbrida DesdeCapitoleestamos acompañando a uno de nuestrosclientes TOPen la evolución de su asistente conversacional, que hoy atiende amillones de usuarios en todo el mundo.Para este desafío, buscamos sumar un/aSoftware Engineercon experiencia en /...