“promptfoo” jobs in Canada

No matching filters. Try another name.

Results

• 2d

  Senior Forward Deployed Engineer (Gemini Enterprise)

  Montréal, QC +1

  Full Time

  

  Welcome to the Jungle: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3–5 years of software or data engineering experience, hands-on Google AI stack experience (Gemini, Vertex AI), strong Python and TypeScript skills, and experience with RAG, vector search and agentic frameworks. A Google Cloud certification is required within two months of joining if not already held.

  Gemini Enterprise, Vertex AI, BigQuery, Google ADK, LangGraph, LangChain

  29d

  AI & Agentic Engineer, Senior

  Montréal, QC +1

  Full Time

  

  Welcome to the Jungle: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3 to 5 years of software or data engineering experience, recent hands-on work with LLM tools, and strong Python and TypeScript skills. They also need experience with RAG, vector search, an agentic framework, one major AI platform and one cloud platform, plus professional English.

  Claude Code, Gemini CLI, Codex, Cursor, React, Terraform

• 9d

  Senior AI Quality Developer, Personalization

  Toronto, ON

  HybridFull Time

  A

  Autodesk

  6+ YOEAutodesk needs candidates with 6+ years of software or test automation experience and hands-on TypeScript and Python skills. Candidates should have experience testing LLM-based applications, knowledge of RAG and agent architectures, and familiarity with CI/CD and AWS.

  Playwright, Puppeteer, Pytest, AWS, CI/CD pipelines

• 17d

  Staff Engineer, Site Reliability Engineering

  Markham, ON

  HybridFull Time

  GO

  GM of Canada Company

  8+ YOECandidates need 8+ years in SRE, DevOps, or systems engineering, with cloud-native production experience, strong observability and CI/CD skills, and solid programming ability in Python, Go, or Java. A relevant technical degree (BS, MS, or PhD) is required, along with strong communication skills.

  Azure Databricks, Azure Event Hubs, Azure Kubernetes Service, Terraform, Helm, Kustomize

• 19d

  Senior Software Development Engineer in Test (SDET), QA - AI Systems

  Toronto, ON

  RemoteFull Time

  

  Nexxa.AI

  5+ YOECandidates need 5+ years as an SDET or QA or software engineer with a testing focus, strong Python skills and experience building test frameworks from scratch. They also need hands-on experience testing LLM-based products or AI agents and evaluation tools.

  promptfoo, DeepEval, RAGAS, LangSmith, GitHub Actions, GitLab CI

• 21d

  Hybrid! Systems Testing/QA Specialist - Senior, 6 months contract

  Toronto, ON

  DT

  Dimensional Tech Inc.

  10+ YOECandidates need at least 3 years of AI-assisted testing experience, including building AI-powered QA agents with agentic AI, LLM and chatbot technologies. They also need 10+ years of testing large-scale on-premise, cloud and mobile applications, and hands-on use of AI testing tools such as DeepEval, Applitools and Promptfoo.

  DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Copilot Studio Kit

• 21d

  Développeur·euse QA, Assistant IA

  Montréal, QC +1

  

  Poka FR

  2+ YOE2 à 4 ans d'expérience pertinente en test ou SDET; Maîtrise de Python et de TypeScript; Intérêt pour le comportement des LLM et leurs échecs

  Python, TypeScript, promptfoo, Claude Code, AWS, Docker

• 22d

  QA Developer, AI Assistant

  Montréal, QC +1

  

  Poka EN

  2+ YOECandidates need 2 to 4 years of relevant experience, a background in test automation or as an SDET, and programming skills in Python and TypeScript. Curiosity about how LLMs behave and comfort judging quality without a single right answer are also required.

  Python, TypeScript, Claude Code, promptfoo, AWS, Docker

• 22d

  Senior Software Engineer, Test

  Hamilton, ON

  Full Time

  P

  Providius

  5+ YOECandidates need 5+ years of software quality engineering, test automation or software engineering experience, strong programming skills, and CI/CD integration experience. Experience testing non-deterministic AI, ML or LLM systems is required.

  pytest, JUnit, Playwright, Cypress, Postman, k6

• 24d

  RQ00822 - Systems Testing/QA Specialist - Senior

  Toronto, ON

  $56.16–$84.24/hr

  SC

  Source Code

  10+ YOECandidates need 10+ years of large-scale application testing and 3+ years of AI-assisted testing, including building AI-powered QA agents with LLM technologies. Experience with AI testing tools such as DeepEval, Applitools or Promptfoo, plus SAP or Salesforce, is required.

  Micro Focus UFT, TOSCA, Selenium, Cucumber, JMeter, OpenText ALM

• 24d

  Senior Quality Assurance Specialist (AI Testing / QA Lead)

  Toronto, ON

  $70–$82/hrContract

  

  Altis

  10+ YOECandidates need 10+ years of enterprise application testing experience, including at least 3 years of AI-assisted testing, plus a post-secondary degree in computer science or a related field, strong QA leadership and excellent English communication.

  Micro Focus UFT, TOSCA, Selenium, Cucumber, JMeter, OpenText LoadRunner

• 24d

  Senior Systems Testing/QA Specialist

  Toronto, ON

  Contract, Temporary

  M

  modis

  10+ YOECandidates need 10+ years of testing large applications and at least 3 years of AI-assisted testing, including building AI-powered QA agents. Hands-on work with AI testing tools such as DeepEval or Applitools and required security clearance are also needed.

  DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Copilot Studio Kit

• 24d

  Senior Systems Testing/QA Specialist

  Toronto, ON

  Contract

  

  Randstad Canada

  10+ YOECandidates need 10+ years of enterprise QA testing and 3+ years of AI-assisted testing experience. They must know tools such as Selenium, Cucumber, Jira, DeepEval or Promptfoo.

  Selenium, Cucumber, Micro Focus UFT, OpenText ALM, Octane, Jira

• 26d

  Analyste informatique - IA (Assignation temporaire durée indéterminée)

  Montréal, QC

  

  Hydro-Québec: L'entreprise comprend quatre divisions :

  3+ YOEBaccalauréat en informatique; Moins de 3 ans d'expérience en ingénierie logicielle, apprentissage automatique, science des données ou sécurité; Connaissance de l'évaluation des LLM et des risques de l'IA générative

  Python, promptfoo, garak, PyRIT, Inspect, Langfuse

• 27d

  Senior Forward Deployed Engineer (Gemini Enterprise)

  Montréal, QC +1

  Full Time

  

  LinkedIn Job Wrapping: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3 to 5 years of software or data engineering experience, strong Python and TypeScript skills, and hands-on work with Gemini, Vertex AI and RAG. Artefact also expects fluency with agentic coding tools and GCP experience, and a Google Cloud certification (or commitment to obtain one within two months).

  Gemini Enterprise, Vertex AI, Google ADK, BigQuery, LangGraph, LangChain

  27d

  AI & Agentic Engineer, Senior

  Montréal, QC +1

  Full Time

  

  LinkedIn Job Wrapping: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3-5 years of software or data engineering experience, with recent hands-on work on LLM-based development. Strong Python and TypeScript skills, RAG and agentic framework experience, and specialization in one AI platform plus a cloud platform are required, along with fluent English.

  React, Python, TypeScript, Terraform, Claude Code, Gemini CLI

• 29d

  Applied AI Engineer

  Montréal, QC

  RemoteFull Time

  

  Velixo

  Velixo needs candidates with production experience building on LLM APIs, experience building eval harnesses, and fluency with token accounting, context management and caching. Python or TypeScript proficiency and strong data analysis skills are required, plus clear writing for non-technical audiences.

  Langfuse, promptfoo

• 29d

  Senior Software Engineer

  Toronto, ON

  HybridFull Time

  ?

  5+ YOEThese tools are the bridge between TR’s authoritative content and the AI products, such as CoCounsel Legal, that depend on them, and they carry high stakes — every result must be accurate…; Treat delivery friction as a…

  Research, Python, AWS, GitHub, Datadog, Root cause analysis

• 29d

  Senior Forward Deployed Engineer (Gemini Enterprise)

  Montréal, QC +1

  Full Time

  

  Artefact: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3 to 5 years of software or data engineering experience, hands-on work with Gemini, Vertex AI and GCP, and strong Python and TypeScript skills. A Google Cloud certification such as the Professional Machine Learning Engineer is preferred and must be obtained within two months of starting.

  Gemini Enterprise, Vertex AI, BigQuery, Google Agent Development Kit, React, Terraform

  29d

  AI & Agentic Engineer, Senior

  Montréal, QC +1

  Full Time

  

  Artefact: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3 to 5 years of software or data engineering experience, with recent hands-on work building LLM-based features. They need strong Python and TypeScript skills, React and backend experience, RAG and agent frameworks, and expertise in one major AI platform such as Google, Anthropic, or OpenAI, plus fluent professional English.

  React, LangGraph, LangChain, Vertex AI, Claude Code, Gemini CLI

• 29d

  Senior Forward Deployed Engineer (Gemini Enterprise)

  Montréal, QC +1

  Full Time

  

  Artefact North America: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3 to 5 years of software or data engineering experience, hands-on Google AI stack work (Gemini, Vertex AI) and strong Python and TypeScript skills. A Google Cloud certification such as Professional Machine Learning Engineer is strongly preferred, and must be obtained within 2 months if not held.

  Gemini Enterprise, Vertex AI, BigQuery, Google ADK, LangGraph, LangChain

  29d

  Senior, AI & Agentic Engineer

  Montréal, QC +1

  Full Time

  

  Artefact North America: Artefact is a leading global consulting company dedicated to accelerating the adoption of data and AI to positively impact people and organizations.

  3+ YOECandidates need 3 to 5 years of software or data engineering experience, with recent hands-on LLM development. They need strong Python and TypeScript skills, React, RAG and agentic framework experience, expertise on one major AI platform and cloud, and fluent English.

  React, LangGraph, LangChain, Vertex AI, Claude Code, Cursor

• 29d

  Staff Software Developer – AI Products

  British Columbia

  $147k–$167k/yrHybridFull Time

  

  Safe Software

  7+ YOECandidates need about 7 years of production backend experience and depth in a modern backend language, ideally with FastAPI. They should have hands-on work with LLM-based agentic applications and LLM evaluation, plus a proven ability to lead ambiguous technical projects.

  FastAPI, LangChain, FME, Docker, Kubernetes, pgvector

19 companies