Apply now

Posted 20 days ago

Senior AI Engineer (NVIDIA + LLM Inference) - Onsite - Toronto, Canada

@ FullStack

Toronto, Ontario

Full-time5+ years experience
Apply now
SIGNALS

Overview

FullStack is hiring a Senior AI Engineer for NVIDIA and LLM inference work, placed onsite in Toronto for its U.S. clients on a full-time, project-based basis. The role involves deploying and scaling self-hosted LLMs and embedding models on GPU infrastructure, including private, on-premises inference platforms in secure environments. Applicants must be authorized to work in Canada full-time, as FullStack does not sponsor work visas.

Responsibilities:

  • Deploy and self-host LLMs and embedding models on GPU infrastructure
  • Serve and scale inference workloads on Kubernetes GPU clusters
  • Build and operate private, on-premises AI inference platforms
  • Implement guardrails and controls for production LLM applications
  • Integrate with client teams on daily development work

Requirements summary:

  • 5+ years in AI/ML, software or ML infrastructure engineering
  • Hands-on NVIDIA inference stack experience
  • Production LLM deployment experience on GPUs
  • Four-year college degree required
  • Advanced English required
  • Experience on Agile / Scrum teams

Tools & skills

Source and dates

Source type not verified · apify-linkedin

Employer posting date
2026-10-25
First seen by our source
2026-11-14
Source record updated
2026-11-14

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SenioritySenior
DepartmentSoftware development
Experience5+ years
Hours per week40 (estimated)
Work settingOffice
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationBachelor’s degree (required)

Summary and details written by AI from the posting; the employer’s posting is the authority.

FullStack

FieldValue
Open jobs on Jobsy2
Job description
About FullStack

FullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI; few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.

We’re Most Proud Of

  • Offering life-changing career opportunities to talented software professionals across the Americas.
  • Building highly-skilled software development teams for hundreds of the world’s greatest companies.
  • Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
  • Our 4.1-star rating on GlassDoor.
  • Our client Net Promoter Score of 68, twice the industry average.

The Opportunity

Join our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).

  • You will integrate directly into our client's team and work alongside their existing designers and engineers on a daily basis.

What We're Looking For

  • 5+ years of professional experience in AI/ML engineering, software engineering, or machine learning infrastructure.
  • Advanced English is required.
  • Successful completion of a four-year college degree is required.
  • Strong hands-on experience with NVIDIA's AI inference stack, particularly NVIDIA NIM, NeMo, NeMo Guardrails, TensorRT-LLM, and Triton Inference Server.
  • Proven experience deploying and self-hosting LLMs and embedding models in production on GPU infrastructure.
  • Practical experience serving and scaling inference workloads, including GPU cluster operations and Kubernetes-based environments, ideally using the NVIDIA GPU Operator.
  • Strong theoretical and applied understanding of LLMs, including inference optimization, model serving, and the operational challenges of running models at scale.
  • Experience building and operating private, on-premises AI inference platforms in secure environments.
  • Ability to implement guardrails and controls for production LLM applications.
  • Experience working in banking or other regulated industries is a plus.
  • Ability to work through new and difficult issues and contribute to libraries as needed.
  • Ability to create and maintain continuous integration and delivery of applications.
  • Forensic attention to detail.
  • A positive mindset and a can-do attitude.
  • Experience working on Agile / Scrum teams.
  • Meaningful experience working on large, complex systems.
  • Ability to take extreme ownership over your work. Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon.
  • Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them.

Nice To Have

We’re Seeking Engineers Who Are AI-enthusiastic In Their Workflow. Professional Experience Or Personal Project Work With The Following Is a Significant Plus

  • Cursor, Windsurf, or Google Antigravity.
  • Claude Code, Gemini CLI, Codex, or Copilot CLI.

Work Authorization Requirements

  • Applicants must be currently authorized to work in the country of this job posting on a full-time basis.
  • FullStack will not sponsor applicants for work visas now or in the future.

What We Offer

  • Competitive pay.
  • The ability to work with leading startups and Fortune 500 companies.
  • Continuing education opportunities.
  • Opportunity to grow and expand your career.

Our talent network is committed to fostering a diverse, inclusive, and accessible environment where IT professionals can find opportunities that match their skills. We welcome individuals of all races, religions, genders, sexual orientations, national origins, abilities, and experiences. Our focus is on connecting talent with projects based on qualifications, ensuring a fair and transparent process that values diverse perspectives and global collaboration.

Learn more about our Applicants Privacy Notice.

Similar jobs

  • AI Engineer - Senior Consultant

    Toronto, ON
    Full Time

    Slalom

    5+ YOECandidates need 5+ years of experience deploying models into production, strong Python skills, and hands-on work with RAG, agentic workflows or fine-tuning. Cloud experience with AWS, GCP or Azure and consulting communication skills are also required.

    Python, Databricks, Snowflake, AWS, GCP, Azure

  • AI Engineer

    Toronto, ON
    Full Time

    Virtusa

    10+ YOECandidates need 10 to 15 years of experience, with advanced Python and SQL skills (7 to 10 years). Hands-on experience with AWS Bedrock, SageMaker, LLM fine-tuning, LangGraph and RAG is mandatory, and AWS certifications are preferred.

    AWS Bedrock, AWS SageMaker, LangGraph, Python, SQL

  • AI Engineer, Trust & Evaluation

    Toronto, ON
    HybridFull Time

    Equinix Canada Ltd.

    1+ YOECandidates need 1 to 4 years of AI/ML or software engineering experience, strong Python skills and hands-on experience building LLM or agent evaluation systems. They also need working knowledge of evaluation statistics, SQL and clear communication.

    Python, SQL, Google Cloud, Vertex AI, Kubernetes, OpenTelemetry

  • AI Engineer

    Mississauga, ON
    Full Time

    Smart IT Frame LLC

    8+ YOECandidates need 8+ years of software engineering experience, strong Python skills with FastAPI or Flask, and production AI/LLM application experience. A Bachelor's or Master's in Computer Science or equivalent is expected.

    Python, FastAPI, Flask, Docker, Kubernetes, Kafka

  • AI ENGINEER - PYTHON

    Mississauga, ON
    Full Time

    SIDRAM TECHNOLOGIES

    12+ YOESIDRAM TECHNOLOGIES needs candidates with 12+ years of experience, strong Python with FastAPI or Flask, and production AI/LLM development skills. Strong SQL, data engineering, async programming, and architecture and leadership experience are also required.

    Python, FastAPI, Flask, LangChain, LangGraph, Docker

    AI Engineer

    Mississauga, ON
    Full Time

    SIDRAM TECHNOLOGIES

    10+ YOECandidates need 10+ years of experience, strong Python with FastAPI or Flask, production AI/LLM application work, and solid SQL and data engineering skills. Strong architecture and technical leadership, plus a Bachelor's or Master's in Computer Science or equivalent, are also expected.

    Python, FastAPI, Flask, Docker, Kubernetes, Kafka

  • AI Engineer

    Mississauga, ON
    Full Time

    Altimetrik

    Candidates need strong Python development with FastAPI or Flask, production AI or LLM application experience, and solid SQL and data engineering skills. Strong architecture and technical leadership abilities are also required.

    Python, FastAPI, Flask, SQL, Docker, Kubernetes

  • AI Engineer (Python and AI)

    Toronto, ON
    Contract

    Collabera

    6+ YOECollabera needs candidates with 6+ years of software engineering experience, including 1-2+ years building GenAI applications. Strong Python, AWS and hands-on experience with RAG, agentic AI and frameworks such as LangChain or LlamaIndex are required.

    Python, AWS, Bedrock, EKS, Lambda, Fargate

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.