**Building the Future: Introducing the CNCJ AI Infra SIG**
As we all know, AI is advancing from generative AI to agents, driving growing demand for scalable, efficient infrastructure. Kubernetes and the broader Cloud Native ecosystem are becoming increasingly critical foundations for modern AI workloads.
To bring together Japan-local engineers, researchers, and platform builders to share best practices, operational experiences, and emerging technologies for Cloud Native AI infrastructure, **Cloud Native Community Japan (CNCJ) is launching the AI Infra SIG under the CNCF Japan chapter.**
In this post, we introduce the motivation behind the AI Infra SIG, its mission, and the FIRST meetup—along with an open call for speakers.
—
## **Why We Are Launching the AI Infra SIG**
### **The Emergence of Infrastructure Challenges for AI Workloads**
The Cloud Native ecosystem has historically evolved around web applications and microservices. These workloads are typically stateless, CPU- and memory-oriented, and exhibit relatively predictable traffic and scaling patterns.
Modern AI workloads, however—particularly those powered by Large Language Models (LLMs) and AI agents—present a new set of infrastructure challenges. They show heavy dependence on specialized hardware (e.g., GPUs), complex distributed processing and orchestration, and unique traffic and scaling characteristics.
To address these challenges, the Kubernetes community has been actively advancing its vision of **AI Readiness**, introducing new capabilities, projects, and standards for AI-native infrastructure.
### **Japan’s Growing Role in Cloud Native AI**
Japan is also home to a growing community of practitioners, contributors, and organizations actively working in this space. Many engineers from Japan are already involved in open-source projects and community discussions across the Cloud Native AI ecosystem.
At the same time, innovation is extending well beyond Kubernetes and CNCF. Across the broader Linux Foundation ecosystem, AI and agent technologies are rapidly emerging as major areas of community-driven development.
These developments are not limited to global communities. Japan has an active and growing ecosystem of engineers, researchers, and open-source contributors participating across CNCF, the PyTorch Foundation, the Agentic AI Foundation, and other Linux Foundation projects. Events such as **AGNTCon + MCPCon Japan 2026** further highlight the growing momentum around Cloud Native AI and Agentic AI technologies within Japan.
As innovation continues, we believe there is a unique opportunity to strengthen collaboration within Japan while connecting local practitioners to the broader global open-source ecosystem. This is one of the key motivations behind launching the **CNCJ AI Infra SIG**.
—
## **Mission and Activities**
The CNCJ AI Infra SIG aims to bring together engineers, researchers, and platform builders who are shaping the future of AI infrastructure on Cloud Native technologies.
Our mission is to:
– **Share optimization techniques, operational best practices, and real-world experiences** for building and operating AI infrastructure and workloads.
– **Strengthen Japan’s engagement with upstream open-source projects** and contribute back to the broader AI-related Cloud Native and Linux Foundation ecosystems.
To achieve these goals, the AI Infra SIG will organize regular community activities to facilitate knowledge sharing and collaboration around Cloud Native AI infrastructure, including:
– Meetups covering practical experiences, emerging technologies, and updates from upstream communities.
– Joint initiatives with other CNCJ communities, such as Cloud Native Security Japan, Cloud Native Platform Engineering Japan, and CoHDI Japan.
– Collaborative events with companies, research institutions, and broader open-source communities across the Linux Foundation ecosystem, including the PyTorch Foundation and Agentic AI Foundation.
The AI Infra SIG welcomes discussions and contributions across the Cloud Native AI infrastructure ecosystem, including but not limited to:
– **Scheduling**: Dynamic Resource Allocation (DRA), Workload-Aware Scheduling, Kueue
– **Orchestration**: JobSet, LeaderWorkerSet, KubeRay
– **AI Deployment Platforms**: KServe, llm-d, N, AIBrix
– **Networking**: Gateway API Inference Extension, kgateway, Envoy AI Gateway
– **Agent Infrastructure**: agentgateway (AAIF) and Agent Sandbox
– **Standards and Conformance**: AI Conformance and related standardization efforts
—
## **Join Our First Meetup & Call For Speakers!**
To celebrate the launch of the SIG, we are delighted to invite you to our first meetup, **themed “Let’s Get Started with the CNCJ AI Infra SIG — Where Are We Today?”**
Together, we’ll explore the current landscape of Cloud Native AI infrastructure and discuss the latest developments across Kubernetes, CNCF, and the broader open-source ecosystem.
We’d also love to hear from practitioners, researchers, and contributors working on AI infrastructure, platforms, and open source projects. If you have experiences, insights, or emerging ideas to share, please consider submitting a session proposal or lightning talk.
### **Get Involved**
The CNCJ AI Infra SIG is open to anyone interested in Cloud Native AI infrastructure—from engineers and platform builders to researchers, operators, and open-source contributors.
There are many ways to participate:
– 🎤 **Submit a talk proposal** and share your experiences, insights, or lessons learned.
– 🙋 **Join our first and upcoming meetup** and connect with fellow practitioners.
– 🤝 **Contribute to the community** through discussions, collaboration, and knowledge sharing.
– 🌐 **Stay connected with CNCJ** for updates on future AI Infra SIG activities and other Cloud Native events.
Whether you’re running AI workloads in production, contributing to upstream projects, exploring new technologies, or just getting started, we’d love to have you join us.
We look forward to seeing your proposals and welcoming you to the CNCJ AI Infra SIG community!
—
## **FAQ**
### **What is the CNCJ AI Infra SIG?**
The CNCJ AI Infra SIG (Special Interest Group) is a community initiative under the CNCF Japan chapter, aimed at bringing together engineers, researchers, and platform builders in Japan to share best practices, operational experiences, and emerging technologies for building and operating AI workloads using Cloud Native technologies.
### **What is the mission of the AI Infra SIG?**
The mission is twofold:
1. To share optimization techniques, operational best practices, and real-world experiences for AI/ML infrastructure.
2. To strengthen Japan’s engagement with upstream open-source projects and contribute back to the broader Cloud Native and Linux Foundation ecosystems.
### **What topics will the SIG cover?**
The SIG will cover a wide range of AI infrastructure topics, including:
– Scheduling (e.g., Dynamic Resource Allocation, Kueue)
– Orchestration (e.g., JobSet, LeaderWorkerSet, KubeRay)
– AI deployment platforms (e.g., KServe, AIBrix)
– Networking for AI (e.g., Gateway API extensions, kgateway)
– Agent infrastructure (e.g., Agent Sandbox, agentgateway)
– Standards and conformance (e.g., AI Conformance)
### **Who are the organizers?**
The SIG organizers (in alphabetical order) include:
– Masaya Aoyama (CyberAgent, Inc.)
– Sunyanan Choochotkaew (Pang), IBM Research – Tokyo
– Toru Komatsu (Preferred Networks, Inc.)
– Shingo Omura (LY Corporation)
– Kenta Tada (CNCF End User Technical Advisory Board & eBPF Foundation)
– Kenji Tagashira (Fsas Technologies Inc.)
### **What is the first meetup about?**
The first meetup is themed **“Let’s Get Started with the CNCJ AI Infra SIG — Where Are We Today?”** It will explore the current landscape of Cloud Native AI infrastructure and discuss the latest developments across Kubernetes, CNCF, and the open-source ecosystem.
### **Can I submit a talk or propose a session?**
Yes! The SIG is actively seeking speakers, including practitioners, researchers, and contributors, to share their experiences, insights, and emerging ideas. Topics can range from technical deep dives to real-world deployment case studies. Proposals are open until **August 28, 2026**.
### **How can I participate if I’m new to the community?**
Everyone is welcome—whether you’re running AI workloads in production, contributing to upstream projects, exploring new technologies, or just starting your journey. You can join meetups, contribute to discussions, and engage with the community through various activities.
—
## **Conclusion**
AI and autonomous agents are reshaping not only how applications are built but also how the underlying infrastructure and platforms are designed, operated, and evolved. This marks a pivotal moment for Cloud Native practices as they expand into the AI frontier.
The CNCJ AI Infra SIG provides a vital space for domestic engineers and practitioners to share challenges, consolidate practical knowledge, and contribute to the global open-source ecosystem. By bridging local expertise with upstream collaboration, we aim to accelerate innovation and build a robust AI infrastructure landscape in Japan.
This initiative represents more than a technical effort—it is a community-driven effort to define the future of AI infrastructure in the Cloud Native era. We warmly invite you to join us, contribute, and help shape what’s next.
**We look forward to welcoming you to the CNCJ AI Infra SIG community!**
*本記事は、Shingo Omura (LY Corporation)、Sunyanan Choochotkaew (Pang)、IBM Research – Tokyoによって執筆されました。*
