Senior Chaos Engineer

Enterprise AI is moving from pilots to production, and the constraint is no longer the model — it's the data. Agents are only as good as what they can sense, trust, and act on in the moment, and real-time, event-driven data is becoming the foundation every serious AI system runs on.

Solace is the leading platform for the enterprise AI era. Established enterprises worldwide — including RBC Capital Markets, Bosch, Heineken, PSA Singapore, United Airlines, Schwarz Group, and hundreds more — have built their business around Solace to enable intelligent, real-time experiences, modernize their application and integration landscape, and create seamless digital journeys for their customers, partners, and employees.

So, the next time you drive a car, order furniture online, fly in a plane, check your bank balance on your phone, your positive experience could be a direct result of our technology—and your hard work!

About the Role

At Solace, reliability is a feature we build deliberately. Our customers run critical systems such as financial trading platforms, airlines, factories, and supply chains on Solace, and they expect it to behave correctly no matter what the world throws at it. As a Senior Chaos Engineer on our R&D team, you’ll own how we prove that. You’re a systems-level thinker who starts from the problems our customers are trying to solve, builds a clear model of how the whole system should behave, and designs the experiments that reveal where reality and expectation diverge. You’ll set the direction for chaos engineering across our platform, bring deep expertise in fault injection tooling, and chase hard, multi-system failures down to their root cause. You treat AI as a force multiplier and lead the team toward an AI-native way of working, from experiment design to root cause analysis. You’ll partner with squads across R&D to turn findings into fixes that make Solace more resilient for the enterprises that depend on it.

What You’ll Do

• Own the chaos engineering strategy for the Solace platform, deciding which failure modes matter most based on how customers deploy and depend on our products
• Build a deep understanding of customer use cases and translate them into explicit expectations of how the system must behave under failure
• Design, implement, and execute chaos experiments, and other cloud-provider fault injection services, covering infrastructure, network, storage, and application faults and their combinations
• Verify that the system behaves correctly under failure, not just that it stays available
• Debug complex, multi-system failures with rigor and curiosity, tracing issues to their root cause
• Leverage AI to scale experiment design, augment and largely automate analysis, and accelerate root cause investigations, and lead the team toward AI-native ways of working
• Partner with engineering squads and product across R&D to drive remediation, influence designs early, and embed resilience thinking into how we build and operate
• Define reliability metrics and report outcomes in terms of customer impact, turning results into concrete recommendations and priorities
• Mentor engineers and raise the bar for how the team reasons about failure, risk, and quality

What You’ll Bring to the Role

• 7+ years of experience in software engineering, system-level engineering, or chaos engineering, including significant time testing or operating distributed systems in production
• Strong systems thinking, with the ability to reason about the whole system end to end and predict how failures combine and cascade
• A customer-first mindset: you start from what customers are trying to achieve and define correct behavior from there
• Proven experience designing and leading chaos engineering programs with Chaos Mesh and/or cloud-provider fault injection services such as AWS Fault Injection Service, Azure Chaos Studio, or GCP fault injection testing
• Deep knowledge of distributed systems concepts and failure modes, ideally in event-driven architectures
• Exceptional debugging and root cause analysis skills; you don’t stop until you understand why
• Solid expertise in cloud environments (AWS, Azure, or GCP), Kubernetes, and observability tooling (metrics, logs, traces)
• Ability to build and evolve experiment tooling, workload generators, and verification harnesses, with AI doing much of the coding and you owning the design and the judgment
• Enthusiasm for AI as a native part of how you work, and the ability to bring that mindset to the people around you
• A track record of influencing across teams without direct authority, communicating risk clearly, and mentoring other engineers
• Experience with messaging systems or event streaming technologies (Solace, Kafka, MQTT, AMQP, JMS) is a strong asset

Why You’ll Love Working at Solace

At Solace, we’re all about smart people, meaningful work, and good vibes.

• Work with brilliance – Our team is packed with some of the sharpest minds in the industry.
• Balance matters – We believe work should fit into your life, not the other way around.
• Hybrid-first – Flexibility is built into how we work, so everyone feels included and empowered.
• Values-driven – We live and breathe our core values: craftsmanship, trust, courage, freedom, momentum, humility, and human experience.
• Growth mindset – Our training programs are designed to help you level up, fast.
• Customer Obsessed – We’re proud of our world-class customer lineup (we’re not shy about it).
• Keep it fun – We’re social, we keep things simple, and we know how to have a good time.
• Creative culture – We’ve got a great sense of humour and we make cool videos on topics like MITT and this (check them out!).

Role Status: NEW

At Solace, we are committed to a fair, inclusive, and transparent recruitment process.
To help identify candidates whose qualifications best align with the role, we use artificial intelligence (AI) tools during the initial stage of resume screening. These tools compare submitted resumes to the job description, focusing on education, experience, and skills.

Importantly, all decisions beyond this initial screening—including interviews and final hiring—are made by our human recruitment team. AI is never used to make final hiring decisions.

Let’s Talk

Not sure you meet every requirement? That’s okay — we’re more interested in your potential and passion. If this role excites you, we’d love to hear from you.

Need accommodations during the hiring process? Just let us know — we’re here to support you.

Thanks to everyone who applies! While we wish we could connect with every candidate, only those selected to move forward will be contacted.

At Solace, we believe that diversity and inclusion drive innovation and growth, both in business and in life. We strive to create an enriching and safe workplace where you can be who you are. If you want to do the best work of your career and feel supported every step of the way, we encourage you to join us!

#LI-NM1