Software Engineer

Software Engineer - Data Infrastructure - KafkaJoin to apply for the Software Engineer - Data Infrastructure - Kafka role at Canonical.Canonical is building a comprehensive automation suite to provide multi‑cloud and on‑premise data solutions for the enterprise. The data platform team is a collaborative team that develops managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL, cache‑layer capabilities, and analytics; all the way to structured SQL engines (similar to Amazon RDS approach). We are facing the interesting problem of fault‑tolerant mission‑critical distributed systems and intend to deliver the world’s best automation solution for delivering managed data platforms. We are looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event‑stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open‑source community dynamics and equally aware of the needs of large, innovative organisations.Location: European, Middle East and African time zones.What your day will look likeThe data platform team is responsible for the automation of data platform operations, with the mission of managing and integrating Big Data platforms at scale. This includes ensuring fault‑tolerant replication, TLS, installation, backups and much more; but also provides domain‑specific expertise on the actual data system to other teams within Canonical. This role is focused on the creation and automation of infrastructure features of data platforms, not analysing and/or processing the data in them.Collaborate proactively with a distributed teamWrite high‑quality, idiomatic Python code to create new featuresDebug issues and interact with upstream communities publiclyWork with helpful and talented engineers including experts in many fieldsDiscuss ideas and collaborate on finding good solutionsWork from home with global travel for 2 to 4 weeks per year for internal and external eventsWhat we are looking for in youProven hands‑on experience in software development using PythonProven hands‑on experience in distributed systems, such as Kafka and SparkHave a Bachelor’s or equivalent in Computer Science, STEM, or a similar degreeWillingness to travel up to 4 times a year for internal eventsAdditional Skills That You Might Also BringExperience operating and managing other data platform technologies, SQL (MySQL, PostgreSQL, Oracle, etc.) and/or NoSQL (MongoDB, Redis, ElasticSearch, etc.), similar to DBA level expertiseExperience with Linux systems administration, package management, and infrastructure operationsExperience with the public cloud or a private cloud solution like OpenStackExperience with operating Kubernetes clusters and a belief that it can be used for serious persistent data servicesWhat we offer youFully remote working environment – we've been working remotely since 2004Personal learning and development budget of 2,000 USD per annumAnnual compensation reviewRecognition rewardsAnnual holiday leaveParental leaveEmployee Assistance ProgrammeOpportunity to travel to new locations to meet colleagues twice a yearPriority Pass for travel and travel upgrades for long‑haul company eventsCanonical is an equal‑opportunity employer. We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products. Whatever your identity, we will give your application fair consideration.Seniority level: Entry level | Employment type: Full‑time | Job function: Engineering and Information Technology | Industries: Software Development#J-18808-Ljbffr