Apply now

Posted 16 months ago

AI Runtime Engineer

@ EnCharge AI

Canada

3+ years experience
Apply now
SIGNALS

Overview

EnCharge AI is hiring an AI Runtime Engineer to build and optimize the execution software stack for its next-generation AI accelerator. The role covers low-latency runtime code for deep learning inference and training across cloud and edge, working with hardware, compiler and framework teams.

Responsibilities:

  • Develop and optimize the AI runtime software stack for deep learning workloads
  • Implement task scheduling, memory management and kernel execution
  • Optimize host-device data movement over PCIe, DMA and shared memory
  • Integrate runtime components with AI compilers and inference frameworks

Requirements summary:

  • Bachelor's or Master's in Computer Science, Electrical Engineering or related field
  • 3+ years of low-level runtime development for AI accelerators, GPUs or HPC
  • Strong C/C++ and low-level systems programming
  • Experience with dataflow architectures and hardware-aware optimization

Tools & skills

Source and dates

Employer career site / ATS feed · greenhouse

Employer posting date
2025-07-10
First seen by our source
2026-10-08
Source record updated
2026-10-10

These dates describe the source record, not a live verification that the employer is still hiring. Check the original posting.

Job details

SeniorityMid level
DepartmentSoftware development
Experience3+ years
Work settingOffice, Laboratory
PositionMostly sitting
Physical demandsphysical low · computer high
LanguagesEnglish
EducationBachelor’s degree (required), Master’s degree (preferred)
Fields of studyComputer Science, Electrical Engineering

Summary and details written by AI from the posting; the employer’s posting is the authority.

EnCharge AI

Saved company profile

Historical company information from a saved The Jobs API profile (LinkedIn/Crunchbase fields). It is not live-verified; figures may have changed. Missing values remain unknown.

Where the future of AI compute is being defined and built, to unlock new levels of machine intelligence.

Full company description

EnCharge AI is a leader in advanced hardware and software systems for AI computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions, at a fraction of the cost. The high-performance architecture is coupled with seamless software and will enable the immense potential of AI to be accessible in power -, energy-, and space-constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

LinkedIn followers
19,885
People associated on LinkedIn
91
Reported office locations
  • 4500 Great American Parkway, Suite 230, Santa Clara, California 95054, US
Business categories
  • Semiconductor
  • Artificial Intelligence
  • Software
  • Embedded Software
  • Artificial Intelligence (AI)
  • Machine Learning
  • AI Infrastructure
Other recorded names
  • EnCharge AI
Profile identifies a recruitment agency
No
Reported total investment
162,900,000

Currency and observation date were not supplied; this is not a current valuation or a funding round.

EnCharge AI is a leader in advanced hardware and software systems for AI computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions, at a fraction of the cost. The high-performance architecture is coupled with seamless software and will enable the immense potential of AI to be…

FieldValue
IndustryEmbedded Software Products
Company size11-50 employees
HeadquartersSanta Clara, California
Organization typePrivately Held
Year founded2022
Open jobs on Jobsy7
LinkedInView page
Job description

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

About the Role

EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments.

Responsibilities

  • Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
  • Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
  • Optimize data movement between host and device using PCIe, DMA, shared memory.
  • Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM
  • Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
  • Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
  • Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments.

Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
  • 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
  • Strong proficiency in C/C++ and low-level systems programming.
  • Deep understanding of task scheduling, concurrency, and memory hierarchy.
  • Experience with hardware-aware optimizations and dataflow architectures.
  • Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
  • Experience with low-latency, high-throughput workload execution for AI models.
  • Strong debugging and profiling skills for optimizing AI execution performance.
  • Exposure to AI model deployment pipelines (Triton, TensorFlow Serving).

EnchargeAI is an equal employment opportunity employer in the United States.

Locations & environments

Locations

All of CanadaRemote · Hybrid · On-site · Field

Pro tip: add remote jobs to widen your search.

Exclude locations

Workplace type

Company jobs in these results

These are this company’s jobs loaded in your current search. The company may have more openings.