About the role

We are looking for an experienced Senior Software Engineer to build developer-facing infrastructure and tooling that scales to millions of test runs per month. You will design and operate language-agnostic systems - spanning distributed execution infrastructure, telemetry and GenAI-powered developer tooling that make pre-production feedback testing fast and trustworthy.

 

Our ideal candidate is passionate about developer productivity and thrives on the satisfaction of empowering Commerce Engineering engineers worldwide to quickly and comprehensively test their software. They are excited to leverage their experience building and maintaining automated testing and resilience platforms to provide long-term benefits.

Key responsibilities

Primary stack: Java, JavaScript/TypeScript, Python, GraphQL, GitHub Actions. You’ll work alongside test frameworks (JEST, Mocha, Playwright) through platform integration work - but you won’t author or maintain test suites yourself

• Implement and manage software solutions that provide accurate and efficient analysis of test runs

• Create and maintain tools for framework-agnostic analysis of distributed tracing tools for test runs

• Stay informed about industry trends and emerging technologies - particularly GenAI applied to developer platforms - to ensure Commerce Engineering remains at the forefront of testing infrastructure

• Develop and integrate software solutions that provide high-quality synthetic test data generation

• Integrate internal and vendor-provided distributed test execution infrastructure into engineering workflows with a focus on reliability and ease of use

• Develop the tools, frameworks and infrastructure that product engineers use to exercise frontend and backend systems - distributed tests execution, mocking, synthetic data, contract verification and performance harness

• Design and operate the systems to automatically detect, quarantine, and self-heal flaky tests - turning noise into an actionable signal for engineers, with GenAI-assisted diagnosis

• Correlate test coverage data with code changes, runtime execution, and trace data for comprehensive reporting

• Maintain a strong focus on scalability, usability, and reliability in platform design to support a growing organization of stunning engineers

• Define testing strategies in partnership with cross-functional teams - producing documentation on frameworks and troubleshooting patterns that internal teams rely on

Must Haves

• A stunning software engineer with experience working on developer platform, platform services, or productivity-tooling teams - energized by unblocking other engineers and amplifying their throughput

• A meticulous software designer who researches and documents technical tradeoffs clearly and concisely

• Deep understanding of distributed systems, service design, and automation platforms (CI/CD, test orchestration)

• Hands-on GenAI fluency - daily use in your engineering workflow, plus experience shipping LLM-powered systems, ideally for developer users

• Ability to independently drive organization-wide solutions and manage complex technical projects from conception to completion

• Ability to synthesize complex technical information and communicate it effectively to both technical and non-technical stakeholders

• Experience establishing strong testing culture, including proficiency with popular test frameworks, code coverage tools, continuous integration systems, and post-deployment verification methods (healthy contempt for flaky tests is a plus)

Nice To Haves

• You have shipped and maintained Java, JavaScript or Python code in production

• You have designed and implemented metrics data pipelines

• Experience running and operating continuous integration systems like GitHub Actions, Jenkins, CircleCI and others 

• Guide the roadmaps of Infrastructure teams according to the specific needs and requirements of product-focused team members

• You have generated and analyzed traces like Distributed tracing/ Zipkin/ Honeycomb/ Datadog/ Splunk/ Elastic Search APM

• You have implemented advanced log, metric, or error stack trace analysis

• You strive to elevate the knowledge and skills of yourself and others in a way that fosters an inclusive, collaborative environment. Deeply enjoy working on solutions that empower other engineers in their work

• Thrive in an ambiguous environment and can self-manage and self-prioritize your time, energy, and resources

• Understand that engineering is a team sport and actively farm for feedback and dissent

• Experience working with a globally distributed team