Overview
Join the AI Gateway engineering team to help build and evolve Kong's API management stack for AI and LLM workloads. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, partnering with a distributed team to deliver reliable, low-latency capabilities. You’ll work on proxying, load balancing, and platform integrations, driving performance and robustness. This role offers the chance to influence how enterprises govern AI-driven API traffic at scale. A strong candidate brings hands-on systems expertise and a proactive, ownership-driven approach.
Retribuzione / Benefits Equity
Premio
Health, dental, and vision insurance
Paid holidays and PTO
Professional development opportunities
Responsabilità Build and maintain API management software for AI/LLM stacks
Develop features such as proxying, load balancing, and database support for Kong AI Gateway
Troubleshoot bugs, tune performance,



and perform low-level optimizations
Bridge Kong with third-party deployment platforms and tooling
Handle additional tasks as assigned by management
Requisiti fondamentali 3+ years of server-side programming
Hands-on experience with Golang or Rust
Proven ability to build and debug highly scalable, distributed, reliable systems
Strong Linux systems troubleshooting and profiling skills
Experience with distributed systems and Linux networking on L7/L4
Comfortable working in a globally distributed team
Strong ownership and communication skills (documentation written by engineers)
Familiarity with AI/LLM concepts
ownership
clear written and verbal communication
collaboration in a distributed team
Golang
Rust
Linux systems programming and profiling

📌 Software Engineer 2, AI Gateway (Latina)
🏢 Kong
📍 Latina