Software Engineer - Voice AI (Inference Runtime)
Toronto, ON +1HybridFull Time
Baseten
Baseten needs a bachelor's degree or higher in Computer Science or a related field and a track record running production real-time systems where tail latency matters. Strong coding skills in a popular language, collaboration skills, and daily use of AI coding assistants are also required.
Python, PyTorch Profiler, vLLM, TensorRT, ONNX, Docker
Software Engineer - GPU Networking & Distributed Systems
Toronto, ON +1HybridFull Time
Baseten
Baseten needs deep experience with high-performance networking such as InfiniBand and RoCE v2, and fluency in C++ or Python. Candidates should understand NVIDIA GPU memory architecture and be comfortable debugging low-level systems.
InfiniBand, RoCE, NCCL, NVSHMEM, NVLink, TensorRT-LLM