Staff Software Engineer, Inference Infrastructure
Toronto, ON +1Cohere: Cohere is the leading security-first enterprise AI company.
5+ YOECandidates need 5+ years of engineering experience running large-scale production infrastructure, especially distributed systems on Kubernetes with GPU workloads. Strong Linux, cloud platform, troubleshooting and performance skills are required, and experience in Golang, C++ or a similar high-performance language is a plus.
Kubernetes, Linux, GPU, GCP, Azure, AWS
Member of Technical Staff, Training Performance Engineer
Toronto, ON +1Cohere: Cohere is the leading security-first enterprise AI company.
Candidates need extremely strong software engineering skills, proficiency in Python and ML frameworks such as JAX, PyTorch and XLA/MLIR, and experience writing GPU kernels with CUDA or Triton. Experience with large-scale distributed training and transformer sequence models is also required.
CUDA, Triton, PyTorch, JAX, XLA, MLIR
Senior Member of Technical Staff, Multimodal AI
Toronto, ON +1Cohere: Cohere is the leading security-first enterprise AI company.
Candidates need exceptional software engineering skills, strong Python, and experience with deep learning frameworks such as JAX, PyTorch and TensorFlow. Experience with distributed training, autoregressive models and evaluating large multimodal models is also expected.
Python, JAX, PyTorch, TensorFlow, CUDA, HuggingFace
Member of Technical Staff, Modeling
Toronto, ON +1Cohere: Cohere is the leading security-first enterprise AI company.
Candidates need extremely strong software engineering skills and proficiency in Python and ML frameworks. Experience writing GPU kernels with CUDA, large-scale distributed training and autoregressive sequence models such as Transformers is also expected.
Python, TensorFlow, TF-Serving, JAX, XLA, MLIR