Software Engineer - Inference Platform
Toronto, ON +1Baseten
3+ YOECandidates need 3+ years building distributed systems or large-scale backend APIs, with experience in low-latency services, observability and performance profiling. Kubernetes, GPU workloads and LLM inference experience are assets, but prior ML experience is not required.
Kubernetes, GPU, vLLM, SGLang, TensorRT-LLM, NVIDIA Dynamo
Software Engineer - Inference Performance
Toronto, ON +1Baseten
Candidates need a bachelor's, master's or PhD in a technical field, experience with Python or C++, and familiarity with LLM optimization and ML libraries such as PyTorch or TensorRT. They also need a deep understanding of GPU architecture and demonstrated interest in LLMs.
PyTorch, TensorRT, TensorRT-LLM, vLLM, SGLang, CUDA
Software Engineer - Voice AI (Inference Runtime)
Toronto, ON +1Baseten
Baseten needs a bachelor's degree or higher in Computer Science or a related field and a track record running production real-time systems where tail latency matters. Strong coding skills in a popular language, collaboration skills, and daily use of AI coding assistants are also required.
Python, PyTorch Profiler, vLLM, TensorRT, ONNX, Docker
Software Engineer - Model Performance Systems
Toronto, ON +1Baseten
Candidates need Python skills, interest in GPU and networking systems, and an automation mindset. Strong communication, the ability to work with vague requirements and mentoring experience are also expected. C++ is a plus.
PyTorch Profiler, NVIDIA Nsight Systems, py-spy, GitHub Codespaces, InferenceMAX, genai-bench
Software Engineer - GPU Kernels
Toronto, ON +1Baseten
Candidates need a strong understanding of GPU architecture and memory hierarchy, proficiency in C++ and GPU profiling tools, and knowledge of the CUDA C++ API, numerical precision and modern GPU features. Experience with Transformer models, Flash Attention, Cutlass, Triton or GEMM tuning is a plus.
CUDA, PTX, Nsight Systems, Nsight Compute, Torch Profiler, Cutlass