Posted 20 days ago
Senior AI Engineer (NVIDIA + LLM Inference) - Onsite - Toronto, Canada
@ FullStack
Toronto, Ontario
Overview
FullStack is hiring a Senior AI Engineer for NVIDIA and LLM inference work, placed onsite in Toronto for its U.S. clients on a full-time, project-based basis. The role involves deploying and scaling self-hosted LLMs and embedding models on GPU infrastructure, including private, on-premises inference platforms in secure environments. Applicants must be authorized to work in Canada full-time, as FullStack does not sponsor work visas.
Responsibilities:
- Deploy and self-host LLMs and embedding models on GPU infrastructure
- Serve and scale inference workloads on Kubernetes GPU clusters
- Build and operate private, on-premises AI inference platforms
- Implement guardrails and controls for production LLM applications
- Integrate with client teams on daily development work
Requirements summary:
- 5+ years in AI/ML, software or ML infrastructure engineering
- Hands-on NVIDIA inference stack experience
- Production LLM deployment experience on GPUs
- Four-year college degree required
- Advanced English required
- Experience on Agile / Scrum teams
Tools & skills
Source and dates
Source type not verified · apify-linkedin
- Employer posting date
- 2026-10-25
- First seen by our source
- 2026-11-14
- Source record updated
- 2026-11-14
These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.
Job details
| Seniority | Senior |
| Department | Software development |
| Experience | 5+ years |
| Hours per week | 40 (estimated) |
| Work setting | Office |
| Position | Mostly sitting |
| Physical demands | physical low · computer high |
| Languages | English |
| Education | Bachelor’s degree (required) |
Summary and details written by AI from the posting; the employer’s posting is the authority.
FullStack
| Field | Value |
|---|---|
| Open jobs on Jobsy | 2 |
FullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI; few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
We’re Most Proud Of
- Offering life-changing career opportunities to talented software professionals across the Americas.
- Building highly-skilled software development teams for hundreds of the world’s greatest companies.
- Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
- Our 4.1-star rating on GlassDoor.
- Our client Net Promoter Score of 68, twice the industry average.
Join our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).
- You will integrate directly into our client's team and work alongside their existing designers and engineers on a daily basis.
- 5+ years of professional experience in AI/ML engineering, software engineering, or machine learning infrastructure.
- Advanced English is required.
- Successful completion of a four-year college degree is required.
- Strong hands-on experience with NVIDIA's AI inference stack, particularly NVIDIA NIM, NeMo, NeMo Guardrails, TensorRT-LLM, and Triton Inference Server.
- Proven experience deploying and self-hosting LLMs and embedding models in production on GPU infrastructure.
- Practical experience serving and scaling inference workloads, including GPU cluster operations and Kubernetes-based environments, ideally using the NVIDIA GPU Operator.
- Strong theoretical and applied understanding of LLMs, including inference optimization, model serving, and the operational challenges of running models at scale.
- Experience building and operating private, on-premises AI inference platforms in secure environments.
- Ability to implement guardrails and controls for production LLM applications.
- Experience working in banking or other regulated industries is a plus.
- Ability to work through new and difficult issues and contribute to libraries as needed.
- Ability to create and maintain continuous integration and delivery of applications.
- Forensic attention to detail.
- A positive mindset and a can-do attitude.
- Experience working on Agile / Scrum teams.
- Meaningful experience working on large, complex systems.
- Ability to take extreme ownership over your work. Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon.
- Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them.
We’re Seeking Engineers Who Are AI-enthusiastic In Their Workflow. Professional Experience Or Personal Project Work With The Following Is a Significant Plus
- Cursor, Windsurf, or Google Antigravity.
- Claude Code, Gemini CLI, Codex, or Copilot CLI.
- Applicants must be currently authorized to work in the country of this job posting on a full-time basis.
- FullStack will not sponsor applicants for work visas now or in the future.
- Competitive pay.
- The ability to work with leading startups and Fortune 500 companies.
- Continuing education opportunities.
- Opportunity to grow and expand your career.
Learn more about our Applicants Privacy Notice.
Journal
Only you can see this. Kept on this device, and in your account when you sign in.