Apply now

Posted 3 months ago

Senior Software Engineer, AI

@ Klue

Toronto, Ontario

$140k–$230k/yrFull-time
Apply now
SIGNALS

Overview

Klue is hiring a Senior Software Engineer in Toronto to build and optimize LLM-powered agents for search, retrieval and workflow automation. The role leads architecture and experimentation for retrieval-augmented generation systems and owns projects end to end. The posting states a hybrid, office-first schedule with office days on Mondays, Wednesdays and Thursdays.

Pay:

$140,000–$230,000 a year

Responsibilities:

  • Build and ship backend systems powering agentic workflows
  • Own evaluation frameworks for agentic systems at scale
  • Design and optimize retrieval and ranking systems
  • Improve LLM-powered workflows end to end
  • Collaborate across product, infrastructure and data teams

Requirements summary:

  • Backend production experience in search, data pipelines or distributed systems
  • Hands-on experience with search, retrieval or ranking systems
  • Experience building or evaluating agentic or LLM-powered systems
  • Strong software engineering fundamentals in Python
  • Familiarity with vector databases and search infrastructure
  • Cloud infrastructure experience with AWS, GCP or Azure

Tools & skills

Benefits mentioned

DentalStock options
Source and dates

Employer career site / ATS feed · ashby

Employer posting date
2026-08-17
First seen by our source
2026-10-08
Source record updated
2026-10-09

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
DepartmentSoftware development
Hours per week40 (estimated)
Work settingOffice
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
Perks mentionedGenerous paid time off, Flexible hours, Stock or equity, Employee discount

Summary and details written by AI from the posting; the employer’s posting is the authority.

FieldValue
Open jobs on Jobsy7
Job description

At Klue, We’re Building the Future of Competitive Intelligence

👋 Klue Engineering is hiring!

We're looking for a Senior Software Engineer to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate compete insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows.

You will shape how we integrate retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops to deliver fast, accurate, and trusted search experiences at scale.

What You'll Do

  • Build and ship backend systems that power agentic workflows. You design retrieval pipelines, orchestration layers, and multi-step agent architectures that turn millions of competitive data points (news, press releases, webpage changes, Slack posts, emails, reviews, CRM data) into actionable intelligence for our customers.

  • Own evaluation of agentic systems at scale. You develop and operate evaluation frameworks (automated, offline, and human-in-the-loop) that measure relevance, quality, latency, and end-to-end task success across our agent pipelines. You'll define what "good" looks like and build the infrastructure to measure it continuously.

  • Design and optimize retrieval and ranking systems. You work across hybrid retrieval, re-ranking, query rewriting, and post-retrieval synthesis to ensure our agents surface the right information at the right time. You understand the tradeoffs between BM25, dense retrieval, and hybrid approaches and know when each matters.

  • Improve LLM-powered workflows end to end. From prompt design and retrieval strategy to caching and latency optimization, you'll make our agent responses faster, more accurate, and more reliable in production.

  • Ship with the customer in mind. You connect technical decisions to customer outcomes. You're energized by understanding how customers use the product, and you use that context to prioritize what to build next. You ship iteratively, measure impact, and course-correct quickly.

  • Collaborate across product, infrastructure, and data teams — align technical direction with product goals, contribute to architecture decisions, and help the team move faster by establishing patterns and best practices for production-grade agentic systems.

  • Stay on the frontier. Evaluate and integrate advances in LLMs, retrieval architectures, and agentic reasoning. You have strong opinions (loosely held) about where this space is heading and bring that perspective to your work.

What You Bring

  • Experience building and operating backend systems in production, with meaningful experience in at least one of: search/retrieval, data pipelines, distributed systems, or API-heavy service architectures.

  • Hands-on experience with search, retrieval, or ranking systems. You've built or significantly improved retrieval pipelines and understand information retrieval fundamentals (hybrid retrieval, relevance tuning, query understanding).

  • Experience building or evaluating agentic / LLM-powered systems. You've worked with retrieval-augmented generation, multi-step agent workflows, or similar architectures and have thought critically about how to evaluate their output quality at scale.

  • Strong software engineering fundamentals. You write clean, maintainable, well-tested code. You're comfortable with Python and have experience with backend frameworks, APIs, and production infrastructure. You care about reliability, observability, and CI/CD.

  • Familiarity with vector databases and search infrastructure. You've worked with tools like FAISS, PGVector, Pinecone, Weaviate, Elasticsearch, or OpenSearch and understand their operational tradeoffs.

  • Experience with cloud infrastructure (AWS, GCP, or Azure) and building systems that handle scale, large data volumes, low-latency requirements, and high availability.

  • You use AI coding tools to accelerate your own work. You've integrated tools like Copilot, Cursor, Claude Code, or similar into your development workflow and can speak to how they've changed the way you build software.

  • Customer-oriented mindset. You've shipped features where you understood the end-user problem, not just the technical specification. You're motivated by customer impact, not just technical elegance.

  • Ability to lead projects and provide technical direction. You can own a problem end to end, make sound architectural decisions, and help others on the team level up.

Nice to Have

  • Experience designing multi-agent systems or complex orchestration workflows.

  • Background in conversational search or dialogue systems.

  • Contributions to open-source projects in search, retrieval, or the LLM ecosystem.

  • Interest in sharing learnings externally (blog posts, talks, open-source contributions).

What Success Looks Like

We're looking for builders who:

  • Take ownership and run with ambiguous problems

  • Jump into new areas and rapidly learn what's needed to deliver solutions

  • Bring scientific rigor while maintaining a pragmatic delivery focus

  • See unclear requirements as an opportunity to shape the solution

Our Tech Stack

  • LLM platforms: OpenAI, Anthropic, open-source models

  • ML frameworks: PyTorch, Transformers, spaCy

  • Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL

  • MLOps tools: Weights & Biases, MLflow, Langfuse

  • Infrastructure: Docker, Kubernetes, GCP

  • Development: Python, Git, CI/CD

We encourage candidates to apply to the engineering role and level that best align with their experience. To support a fair and consistent review process, candidates are limited to one engineering application every 60 days. Applying to multiple roles will not improve consideration, as our team evaluates candidates holistically across our engineering career framework throughout the interview process.

⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️ ⬇️

Not ticking every box? That’s okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that’s different from what we’ve described, be sure to explain why in your application.

At Klue, we're committed to building a high-performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there’s anything we can do to make our hiring process more accessible or to better support you, please let us know, we’re happy to accommodate.

Why Klue Might Be the Perfect Fit For You

At Klue, you’ll push the boundaries of what’s possible. For yourself, your team, and our customers. The environment here feels more startup than corporate. You’ll roll up your sleeves, build, iterate, and level up. This is a place where your ideas matter, you can shape what comes next, and leave your mark.

If you’re looking to join a category-defining company… where you own big outcomes, influence real customers, and work with smart, gritty people… you’ll thrive here.

Unlock Your Potential. Take Risks. Take Action. Innovate

How We Work at Klue

We love the balance of connection and flexibility. We work Office-First, with ahybrid touch, and work together in our vibrant offices on Mondays, Wednesdays & Thursdays to collaborate, brainstorm, and build together.

Our main hiring hubs are in:

  • 🇨🇦 Vancouver (HQ)

  • 🇨🇦 Toronto

  • 🇬🇧 London

Our Commitment to You

  • High Performance Culture. We reward high performance and growth through career development, coaching, and annual performance reviews.

  • Comprehensive benefits: Extended health & dental coverage that starts on Day 1. Fun perks like discounts at Goodlife and Perkopolis are gravy.

  • Ownership: All full-time employees have the opportunity to participate in our Employee Stock Option Plan.

  • Our Vacation Policy is Take The Time You Need. We just ask that you give notice and don’t leave your team hanging.

  • Top-tier tools. All employees will receive a Mac (or PC, if that’s your jam) and access to A+ tooling.

  • AI First. All employees are encouraged to lean into AI to work smarter and faster. Built something cool lately? Show us at our Friday Show, Don’t Tell Meetings.

  • Growth / Leadership. Direct access to our leadership team, including our CEO, and opportunities to connect with incredible people across the company.

  • Social connection. There’s no shortage of ways to stay connected and have fun. We get together once a year in Vancouver for a company- wide kickoff. Throughout the year our Hubs hold regular social events.

  • Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.

About Klue

We’re on a mission to help organizations stop losing winnable deals. Klue’s AI agents generate market, competitor, and buyer insights in a unified platform. We ensure it’s trustworthy, automated, and activated across every department, so they have the answers they need to own their market.

✨ Here’s what makes us tick:

  • Klue is AI-first at its core. It’s wired deep into our internal processes and tooling, powering our small but mighty team. It drives Klue’s autonomous agents that handle the heavy lifting for customers: collecting intel, generating insights, and ensuring content is updated and available across departments. Our agents help them scale their impact, stay ahead of the market, and reclaim the time that used to be consumed by manual, repetitive busywork.

  • Competitor Insights. Klue helps revenue teams win more competitive deals by turning market, competitor, and buyer signals into insights teams can actually use. Our AI analyzes calls, CRM data, and real buyer feedback to give product marketers and sellers a clear picture of what’s happening in their market and why deals are won or lost. We’re a curious, collaborative team building a platform that helps companies compete with confidence, and we’re looking for people who want to do meaningful work alongside others who care about craft and impact.

  • A culture of curiosity, ownership and winning together. We’re a fast-growing, globally-distributed team based in Vancouver (with hubs like Toronto), scaling quicker than ever. We value people who own their domain, act boldly, stay curious and thrive in a collaborative, high-performance environment.

Explore More

By submitting your application, you agree that Klue may collect your personal data for recruiting, global organization planning, and related purposes. We may use automated or AI-assisted tools to support our recruitment process. All hiring decisions are made by our hiring team

Similar jobs

  • Senior Software Engineer, Database

    Ottawa, ON
    $170k–$230k/yrRemoteFull Time

    InfluxData: InfluxData is a remote-first company with a globally distributed workforce.

    8+ YOECandidates need 8+ years of professional software experience, deep knowledge of Rust, C++, or Go, and experience with distributed, high-availability systems. Experience using AI coding tools is also required.

  • Intermediate Software Engineer (Frontend/UI)

    Toronto, ON
    HybridFull Time

    Achievers

    3+ YOECandidates need 3+ years of software engineering experience, solid React and TypeScript skills, and knowledge of accessibility standards and testing. A bachelor's degree in computer science or equivalent practical experience is expected.

    React, TypeScript, GitHub, GCP Gemini Code Assist, Claude, Docker

  • Senior Software Engineer (Azure)

    Concord, ON
    $120k–$140k/yrOn-siteFull Time

    DEG Services

    7+ YOE2+ MgmtCandidates need 7+ years of software engineering experience, including 2+ years in a technical lead or mentoring role and Level 3 production support. Strong hands-on skills with Azure, CI/CD, Infrastructure as Code, APIs and application security are required.

    Microsoft Azure, Azure DevOps, GitHub Actions, Bicep, Terraform, React

  • Software Engineer, Backend

    Toronto, ON
    HybridFull Time

    Operating with the speed and autonomy of a startup and the resources of a global alternative legal services provider, the team builds intelligent agents, reasoning engines, knowledge…; Required Qualifications; 3+ years…

  • Software Engineer, ML Ops

    Toronto, ON
    RemoteFull Time

    AeroVect: The Airport Automation Company

    Candidates need a Bachelor's or Master's in computer science, robotics, data engineering or a related field, with strong Python and working knowledge of ROS2, Docker and AWS. A Master's, MLOps or robotics data experience, and familiarity with Weights & Biases are preferred.

    ROS2, Docker, AWS S3, AWS EC2, Weights & Biases

  • Software Engineer

    London, ON
    $82k–$122k/yrFull Time

    CARFAX

    3+ YOECandidates need 3+ years of object-oriented programming experience, strong Java or Kotlin and Spring Boot skills, and production React or Angular with TypeScript. They also need data pipeline, cloud, database and CI/CD experience, a real commitment to TDD, and the ability to communicate with technical and non-technical audiences.

    Java, Kotlin, Spring Boot, React, Angular, TypeScript

    Senior Software Engineer

    London, ON
    $93k–$139k/yrFull Time

    CARFAX

    5+ YOECandidates need 5+ years of hands-on object-oriented programming, strong Java or Kotlin and Spring Boot experience, and production React or Angular with TypeScript. They also need data pipeline, cloud, database and CI/CD experience, plus a real commitment to TDD and the ability to lead and mentor.

    Java, Kotlin, Spring Boot, React, Angular, TypeScript

  • Senior Software Engineer - Kubernetes platform

    Toronto, ON
    Hybrid

    Cloudflare: (NYSE: NET) is the leading connectivity cloud company.

    Cloudflare needs candidates with experience managing production Kubernetes clusters and operating systems at scale. They should be strong at Linux debugging, IP networking and writing code in Go, TypeScript or shell.

    Kubernetes, Linux, Envoy, Contour, Consul, etcd

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.