Software Dev Mgr, ML Infrastructure, Edge AI Platform

Job ID: 10568253 | Amazon.com Services LLC

Amazon Devices (Lab126) builds products and services that delight millions of customers globally. The Edge AI ML Platform and Infrastructure team is building the platform that enables Amazon teams to train, optimize, evaluate, and deploy generative AI models on devices and in the cloud.

Today, optimizing a large model for a new hardware target requires experts to connect model onboarding, distributed training, compression, evaluation, compilation, and deployment systems by hand. We are turning that work into a repeatable, self‑service workflow. Our platform supports large language, vision, audio, multimodal, and mixture‑of‑experts models, and gives scientists and engineers the tools to move new optimization techniques from research code into reliable production workflows.

We are looking for a Software Development Manager to build and lead the ML infrastructure team behind this platform. You will own distributed training on multi-node GPU clusters, compute capacity and utilization,



CI/CD, observability, and operational reliability for GPU‑intensive workloads. You will hire and develop a team of software and ML infrastructure engineers, set its technical direction and roadmap, and deliver platform capabilities that scientists and product teams depend on to ship models with hundreds of billions of parameters.

This role combines people leadership with deep technical judgment. You will grow engineers and managers-in-the-making, drive architecture decisions with your senior engineers, turn ambiguous science and product needs into a prioritized plan, and hold a high bar for delivery and operational excellence.

Key job responsibilities
- Build, lead, and grow a team of software and ML infrastructure engineers: recruit and hire, set clear goals, coach for growth, and manage performance across the team.
- Own the roadmap for ML infrastructure—distributed training, GPU capaci

📌 Software Dev Mgr, ML Infrastructure, Edge AI Platform (Asti)
🏢 Amazon
📍 Asti