Cast AI, a Miami-headquartered, globally distributed team, seeks an experienced ML systems engineer to own inference stack optimization. You will improve throughput, latency, and cost per token across multi-GPU clusters, shaping the technical direction with data-driven experiments.
Your work spans production-grade Python services, tuning SGLang, vLLM, TensorRT-LLM, and CUDA tooling, with a focus on scalable, cost-efficient inference on customer workloads.
#J-18808-Ljbffr
📌 Senior ML Inference Engineer (Genova)
🏢 Cast Ai
📍 Genova
Candidati a questo annuncio
Mostra le tue capacità professionali all'azienda, compila il form e lascia un tocco personale nella lettera di presentazione, aiuterà il recruiter nella scelta del candidato.