Lead Data Engineer

Social network you want to login/join with:About usAt Auctane, we are united by a passion to help sellers — wherever they are, however they operate — fulfill the promises they make to consumers. The Auctane mission is to fuel commerce through exceptional delivery. We enable businesses to meet rising customer expectations and make the world more accessible. Our brands deliver billions of products annually, totaling over $200 billion in value, worldwide. Auctane is a team of shipping and software experts committed to helping merchants move their ideas globally. Our family includes ShipStation, ShipWorks, ShipEngine, ShippingEasy, Stamps, Endicia, Metapack, Shipsi, GlobalPost, and Packlink. We partner with Amazon, UPS, USPS, eBay, BigCommerce, Shopify, WooCommerce, and Walmart.Our values[Insert values here]About the roleThis is a hands-on role for a Data Engineering Technical Lead within the Data Products team. You will impact the design, implementation, and maintenance of customer-facing data products. Data is central to Auctane's strategy. We operate at a fast pace, using the latest architecture patterns and technologies, processing thousands of events per second with a continuously growing dataset. We strive to improve our data platform and engineering stack to support growth and innovation, providing excellent service to our customers. Our culture is flat and open, emphasizing data-driven decisions, autonomy, and collaboration. We value energy, passion, and working with like-minded individuals.What you'll be doingLead and manage a team of data engineers, contributing to data pipeline and analytics system design, build, and operations using AWS technologies like S3, Athena, Lambda, Kinesis, and ECS.Motivate and develop team members, enhancing their skills and ownership.Collaborate with product owners and stakeholders to implement data product strategies.Develop frameworks and solutions for data acquisition, processing, monitoring, and value extraction.Design and architect data products, contribute to system implementation and operations.Support data analysts and scientists with automation, tooling, and data engineering expertise.Promote data quality and observability, utilizing tools like Airflow, dbt, and Spark.Define team roadmaps based on stakeholder input.Ensure engineering excellence through reliable software and data pipelines, following best practices like automation, version control, CI/CD, testing, and security.Implement and enforce data security and governance standards.Mentor junior colleagues and coach the team on best practices and patterns.What are we looking for?Strong background in Data Engineering.Experience with automated, reliable data pipelines in Python and SQL.Experience with data processing frameworks like Spark, Trino (Athena), Pandas, or DBT.Experience with streaming data processing on cloud platforms (AWS, Azure, Google Cloud).Familiarity with CI/CD environments and automation.Knowledge of data orchestration tools like Airflow, Oozie, Luigi, or Prefect.Understanding of relational and non-relational database design.Experience designing distributed systems and understanding trade-offs.Familiarity with software engineering best practices, source control, automated deployment, and DevOps tools like Terraform.Comfort working in a geographically distributed team.What will make you stand out?Production experience with large datasets.Experience with AWS and big data cloud technologies like EMR, Athena, Glue, BigQuery, Dataproc, Dataflow.Experience with Infrastructure as Code tools such as Terraform or CloudFormation.Knowledge of BI and analytics tools. #J-18808-Ljbffr