Technical Program Manager, Model Performance
Toronto, ON +1Baseten
Candidates need deep technical program management experience on complex programs, and experience with model performance or inference optimization. They should be comfortable building programs from ambiguity and influencing people without authority.
vLLM, TensorRT-LLM, SGLang, NVIDIA Dynamo
Software Engineer - Testing Frameworks
Toronto, ON +1Baseten
Candidates need strong Go and/or Python skills and experience building test tooling used by others. They also need hands-on work with testing frameworks, distributed-system integration testing, load testing tools, Kubernetes and Docker, and CI/CD at scale.
Kubernetes, Docker, k6, Locust, Vegeta, JMeter
Software Engineer - Continuous Delivery
Toronto, ON +1Baseten
Candidates need strong proficiency in Go and/or Python and experience with Kubernetes-based deployment systems at scale. They also need experience building or operating continuous deployment platforms and familiarity with GitOps tooling such as ArgoCD or Flux.
Kubernetes, ArgoCD, Flux, Go, Python
Software Engineer - Observability
Toronto, ON +1Baseten
Candidates need deep experience in at least one observability area such as metrics, logging, tracing or error analytics, plus strong skill in Python, Rust or Go. Experience with platforms like Prometheus, Grafana, ClickHouse or OpenTelemetry and high-throughput data pipelines is expected.
Prometheus, Grafana, ClickHouse, OpenTelemetry
Software Engineer - GPU Networking & Distributed Systems
Toronto, ON +1Baseten
Baseten needs deep experience with high-performance networking such as InfiniBand and RoCE v2, and fluency in C++ or Python. Candidates should understand NVIDIA GPU memory architecture and be comfortable debugging low-level systems.
InfiniBand, RoCE, NCCL, NVSHMEM, NVLink, TensorRT-LLM
Software Engineer - Model Performance Systems
Toronto, ON +1Baseten
Candidates need Python skills, interest in GPU and networking systems, and an automation mindset. Strong communication, the ability to work with vague requirements and mentoring experience are also expected. C++ is a plus.
PyTorch Profiler, NVIDIA Nsight Systems, py-spy, GitHub Codespaces, InferenceMAX, genai-bench
Software Engineer - Infrastructure
Toronto, ON +1Baseten
Baseten needs candidates with a Bachelor's degree or higher in Computer Science or a related field, working coding skills, and a working knowledge of Kubernetes and containers. Basic ML concepts, distributed systems familiarity and monitoring tool experience are also asked for.
Kubernetes, Go, Python
Forward Deployed Engineer
Toronto, ON +1Baseten
2+ YOECandidates need a bachelor's, master's or PhD in computer science, engineering, mathematics or a related field, plus 2+ years of professional experience in a fast-paced environment. Production programming experience, strongly preferably Python, familiarity with ML pipelines and strong technical communication are required.
Python, Docker