Remote Backend Engineer, Experiments Platform

About UsConstructor is the next-generation platform for search and discovery in ecommerce, built to explicitly optimize for metrics like revenue, conversion rate, and profit. Our search engine is entirely invented in-house utilizing transformers and generative LLMs, and we use its core and personalization capabilities to power everything from search itself to recommendations to shopping agents. Engineering is by far our largest department, and we've built our proprietary engine to be the best on the market, having never lost an A/B test to a competitive technology. We're passionate about maintaining this and work on the bleeding edge of AI to do so. About UsConstructor is the next-generation platform for search and discovery in ecommerce, built to explicitly optimize for metrics like revenue, conversion rate, and profit. Our search engine is entirely invented in-house utilizing transformers and generative LLMs, and we use its core and personalization capabilities to power everything from search itself to recommendations to shopping agents. Engineering is by far our largest department, and we've built our proprietary engine to be the best on the market, having never lost an A/B test to a competitive technology. We're passionate about maintaining this and work on the bleeding edge of AI to do so.Out of necessity, our engine is built for extreme scale and powers over 1 billion queries every day across 150 languages and roughly 100 countries. It is used by some of the biggest ecommerce companies in the world like Sephora, Under Armour, and Petco.We're a passionate team who love solving problems and want to make our customers' and coworkers' lives better. We value empathy, openness, curiosity, continuous improvement, and are excited by metrics that matter. We believe that empowering everyone in a company to do what they do best can lead to great things.Constructor is a U.S. based company that has been in the market since 2019. It was founded by Eli Finkelshteyn and Dan McCormick who still lead the company today.About The TeamThe Experiments team at Constructor builds a platform for running A/B experiments and making data-driven decisions about product changes. We also help other teams evaluate hypotheses and improve the quality of search, recommendations, and other services for our customers. Our team currently consists of 4 Software Engineers, 1 Data Analyst, Engineering Manager and Product Manager.For this role, responsibilities are: Owning the whole experimentation process from traffic splitting to revealing experiment results to our customers and internal users. Developing the experiments platform for ML/DS teams, implementing user-facing features for running and analyzing the results of experiments Improving the performance and scalability of our services Improving the trustworthiness, necessary time, and number of experiments by integrating state-of-the-art approaches for AB tests RequirementsYou have hands-on experience building and owning services for production with Python You have experience with monitoring and quality assurance for services that directly affect the customer experience You are ready to dive into the experimental/data analytics domain You're curious about how people use the product you build, not just how it looks from the technical perspective It will be a great match if you have experience building analytical services or experiment platforms It will be a great match if you have experience with PySpark or ETL pipelines. This is not a Data Engineer position, but you might expect to spend 5-10% of your time improving our PySpark pipelines for calculating experiment results Stack: Backend and user-facing services: Python, FastAPI/Flask, Plotly Dash, PostgreSQL, AWS S3, AWS Lambda Data pipelines: PySpark, Databricks, SQL, Airflow/Luigi DevOps: AWS (Cloudformation, RDS), GitHub Actions, Jenkins Monitoring: AWS Cloudwatch, Sentry, Opensearch, Amplitude Benefits ️ Unlimited vacation time - we strongly encourage all employees to take at least 3 weeks per year Fully remote team - choose where you live