October 22, 2026
Separate instances per customer keep multilingual support conversations apart. On GMI Agentbox, every end-user session gets its own dedicated, isolated instance with its own conversation state and tool access, and your application routes each customer to the right one. The support agent is a container you package, and GMI hosts and runs it. Qwen3.8 Max 0902 is in GMI's model library, and Agentbox runs compute and inference on the same network. Agentbox is now in early access.
Language coverage is the model's job; the environment handles everything around it. Each of the five requirements below maps to an Agentbox feature.
| Requirement | What Agentbox provides |
|---|---|
| Customers must not see each other's context | A dedicated instance per end-user session |
| Someone else runs the hosting | Under Option 01 Compute, GMI handles deployment, hosting, and runtime operations |
| The agent stays online between conversations | The Always-on shape keeps an instance running 24/7 |
| Model calls stay simple to wire | Compute and inference run on the same network; models are reached through an OpenAI-compatible endpoint |
| You can see what the agent did | Per-instance status and logs, plus usage by model in the agent's Analytics tab |
Routing a customer to the right language is application logic inside your container. Per-language system prompts and knowledge sources belong to your image or your external store, and settings such as a default language can be passed as TEXT environment variables.
Isolation on Agentbox is per session, and it comes from how instances are created. You register your agent once, and GMI stores the template. Each new conversation starts with a request to Agentbox for an instance of that template; once the instance reports Running, your application routes that customer to it.
In a support deployment:
GMI's Agentbox page describes the same pattern in its Topify customer case: "Every brand needs its own isolated agent runs, and all of them sit on GMI, with 100+ models behind one OpenAI-compatible API plus container hosting and deployment support." You can split by customer, by conversation, or by language-specific agent. Each registered agent has its own template ID, so a language-specific agent is its own template, with knowledge sources and credentials configured per agent.
You supply the support agent as a Docker image, and GMI supplies the managed environment around it.
| Layer | Who handles it |
|---|---|
| Agent code, prompts, language logic, ticketing integrations | You |
| Docker image storage | You, in your own registry. GMI stores the URL and pulls from it on each provision. The wizard also offers a direct upload to GMI's registry for one-off builds |
| Pulling the image and running the container | GMI, each time an instance is provisioned |
| Public endpoint | GMI allocates a public IP and routes your mapped port |
| Instance monitoring and logs | GMI, in the agent's Monitor tab |
| Model inference | GMI Models, on the same network as the container, if you turn on the MaaS integration. With your own provider, you keep that contract |
The container meets the standard Agentbox image requirements covered in the register guide. The register guide walks through the five wizard steps: basics and template, infrastructure, networking, environment variables, and review. The networking step shows the port mapping.

Networking step of the wizard: for a support agent, this is where the public endpoint that your application routes customers to is set up. Source: GMI Cloud docs.
Credentials for your ticketing system, CRM, or knowledge base go in as environment variables of type SECRET. Secret values are replace-only and encrypted at rest, and they stay out of logs and audit history. Non-sensitive settings such as log levels or default language go in as TEXT variables.
Registering stores the template. You launch an instance from the Monitor tab or through the Agentbox API, test the instance's public URL with a sample request, and re-register to iterate. The registration URL stays stable across updates.
Agentbox runs three shapes on one platform, grouped by duration.
| Shape | Duration | Role |
|---|---|---|
| Ephemeral | Seconds | Spin up and tear down in seconds, elastic capacity that scales with demand |
| Long-running | Minutes to hours | Persistent state across multi-step jobs, with low-latency model calls |
| Always-on | 24/7 | Stays online around the clock; use cases include digital workers and monitoring agents |
For support, the choice follows how the agent is used:
Qwen3.8 Max 0902 is available in GMI's model library as a text-to-text LLM.
There are two ways to connect the model, matching Options 01 and 03:
On the first path, container compute and GMI model token usage are metered separately under one GMI account, and each agent's Analytics tab shows usage by model.
State lives outside the container. GMI containers are stateless, so keep conversation history, ticket references, and language preferences in Redis or a database, and inject its credentials as SECRET variables. The instance isolates a session while it runs; your store is what lets a customer come back to the same thread.
Slow multi-step replies need the async pattern. Agent tasks, including multi-step reasoning, can take from 30 seconds to several minutes, longer than a single HTTP request should stay open. The long-running requests guide covers the pattern: return a 202 with a job_id, work in the background, and let the caller poll. A chat front end can use that polling to show a typing indicator while a long answer is assembled.
Logs and status are in the dashboard. Use Monitor to find an instance and open its log. The Integration tab provides the template ID and a four-call lifecycle: provision, list, poll until running, terminate. Session cleanup is code you write against those four calls.
Select every model the agent may call when you turn on MaaS integration; the list stays editable. All of them share the injected key and OpenAI-compatible base URL, so your code passes a different model ID per task, such as one model for language detection and routing and Qwen3.8 Max 0902 for the customer-facing reply.
Three keys sit in three places. Your GMI API token stays with the support backend: it provisions, lists, polls, and terminates instances, and it does not belong in the image or the chat front end. With MaaS integration on, GMI injects the MaaS key into each container at startup, locked so it cannot be overridden. Ticketing, CRM, and knowledge-base keys go in as SECRET variables in the wizard's Env Variables step.
Package the agent you have today, or a minimal version of it, as a Docker image that serves HTTP on port 8080. Register it in the wizard with MaaS integration on, store your ticketing credentials as SECRET variables, launch one instance, and send it a conversation in each language you support. Registration begins in the GMI console, and questions about rolling early access out to your support team go to GMI Sales from the Agentbox page.
Colin Mo
GMI Cloud helps you architect, deploy, optimize, and scale your AI strategies
