Jobherder
  • How it works
  • Pricing
  • Sample output
  • Jobs
  • Blog
  • Help
Log inTry a free sample

← All jobs

EU remote

Software Engineer AI Gateway

Milan, ItalyPosted 17 Jun 2026

Start a search — €9.99Apply on employer site

About this role

Are you ready to unlock intelligence? If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others. THE MISSION You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation.

As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more. WHAT YOU’LL DO - Partake in the entire lifecycle of core AI Gateway features, from design to production rollout. - Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua. - Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.

- Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling. - Troubleshoot production issues in the hot path. - Work with product management and other engineering teams to turn customer requirements into reliable, documented product features. WHAT YOU’LL BRING THE TOOLKIT - 3+ years of programming in server-side applications and components, in a language such as Rust or Go.

- Experience building and debugging applications that are highly scalable, distributed, reliable and resilient. - Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC). - Familiarity with cutting-edge AI models concepts, agentic AI protocols, and AI applications development. - Solid hands-on expertise in Linux systems. THE KONG DNA - Ownership: You have a strong sense of ownership, including the documentation: engineers at Kong write the documentation for their products.

- Collaboration: You have excellent verbal and written communication skills and are comfortable working with a remotely distributed team. BONUS POINTS - Proficiency with Lua. - Hands-on experience with NGINX and OpenResty. - Familiarity with cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure). #LI-EA1 About Kong: Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud.

Jobherder

Stop searching. Start applying.

Product

How a search worksPlans and pricingExample deliveryJob board

Resources

ArticlesHelp centreFor recruitersAgentsAffiliate programme

Features

CV tailoringRemote job searchCareer change

For more information, visit www.konghq.com http://www.konghq.com.

Source listing: ashby_kong

Prefer jobs chosen for you?

Upload your CV and Jobherder returns handpicked roles with a tailored CV and cover letter for each — built from your real experience.

Start a search — €9.99

© 2026 Jobherder

PrivacyTermsSupport