Overview

In this role you will architect and own core components of the AI Gateway to deliver high availability and low latency for AI traffic. You will implement features around prompt engineering, caching, and observability, writing clean Golang and/or Python code. You will influence the roadmap, mitigate technical debt, and build scalable integrations with LLMs and AI platforms. You will mentor engineers and drive end-to-end delivery in a Kubernetes-based environment, collaborating with product teams to translate customer needs into robust solutions. This position offers the chance to shape AI infrastructure at scale while working with a globally distributed team.

Retribuzione / Benefits

- Equity
- Premio
- Health, dental and vision insurance
- Paid holidays and PTO
- Professional development opportunities

Responsabilità

- Design and own core components of the AI Gateway with focus on uptime and performance
- Lead development of features such as prompt engineering, caching, and observability
- Shape technical roadmap and manage long-term architecture and debt




- Architect integrations with multiple LLMs and AI platforms
- Mentor junior engineers through code reviews and design discussions
- Drive end-to-end development lifecycle within a Kubernetes environment
- Collaborate with product managers and cross-functional teams to translate requirements into solutions

Requisiti fondamentali

- Extensive backend development experience, with Golang and/or Python
- Strong understanding of distributed systems, microservices, and API design
- Experience delivering services in cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure)
- Familiarity with API gateways and service mesh technologies
- Solid computer science fundamentals (data structures, algorithms, concurrency)

- Ownership and initiative
- Collaborative, cross-functional communication
- Ability to balance speed with quality in a fast-paced setting
- Golang
- Python
- Distributed systems

📌 Senior Software Engineer, AI Gateway (Milano)
🏢 Kong
📍 Milano