Software Engineer - Inference Performance
Toronto, ON +1HybridFull Time
Baseten
Candidates need a bachelor's, master's or PhD in a technical field, experience with Python or C++, and familiarity with LLM optimization and ML libraries such as PyTorch or TensorRT. They also need a deep understanding of GPU architecture and demonstrated interest in LLMs.
PyTorch, TensorRT, TensorRT-LLM, vLLM, SGLang, CUDA