Reliability

Generative UI turns LLM output directly into interfaces that users see and interact with. The model receives a description of the available components and their properties, then generates an interface that follows that contract. Most generations follow it correctly, but an LLM can occasionally invent a component, use an unsupported value, leave a reference unresolved, or stop before completing the interface.

In our Reliability benchmark, every tested format, including OpenUI, A2UI, and json-render, produced incomplete generations. OpenUI completed 92.9% of the evaluated tasks and produced only 2 blank screens across 1,104 runs, but it was not error-free. Even its strongest model pairing reached 99.5%, not 100%.

Improving reliability

There are four main ways to improve the reliability of LLM-generated interfaces:

• Simplify the component schema. Use distinct component names, clear descriptions, focused properties, and unambiguous enum values. Remove overlapping components and group related ones with componentGroups. See Defining Components.
• Refine the system prompt. Add targeted rules for recurring errors and provide valid examples for combinations the model finds difficult. In our benchmark, a single rule improved one model's completion rate by 13 percentage points, while an incorrect example caused double-digit regressions. See System Prompts.
• Evaluate model selection. Test models using your own component library and representative prompts. Run each prompt multiple times and compare reliability alongside latency and cost.
• Validate and correct generated output. Detect invalid output at runtime and fix it before it reaches users. OpenUI Cloud provides this reliability layer for production applications.

Measure reliability before and after making these changes so you can identify the right intervention and verify that it worked.

Measure reliability

LLM generations are nondeterministic. The same model can produce different output for the same prompt, and an interface that rendered correctly once may contain errors on another attempt. Reliability therefore needs to be measured across representative prompts and repeated generations.

During development

OpenUI DevTools shows the errors captured while OpenUI parses and renders the generated interface. Each entry includes an error summary and additional details, such as the error code, affected component, or statement when available.

This helps identify failures that might otherwise be missed when the rest of the interface still renders. Test representative prompts during development and run important prompts multiple times.

Learn more in developer tools docs.

In production

Development testing cannot cover every prompt your users will submit. Use @openuidev/observability-cloud to monitor UI generation across production traffic and review errors in the Thesys Console.

Install the package:

pnpm install @openuidev/observability-cloud

Create a client API key from the Thesys Console, then initialize observability once in your application:

import * as Observability from "@openuidev/observability-cloud";

Observability.init({
  apiKey: "pk-th-…",
});

After deploying, open the Reliability dashboard to see how frequently generation errors occur, identify the most common error types, and inspect the affected UI generations. This helps you prioritize the schema, prompt, or model changes that will have the greatest impact.

Production reliability with OpenUI Cloud

OpenUI Cloud sits between your application and the LLM. It validates generated UI and fixes errors as it streams to your application.

For every generation, OpenUI Cloud:

• Validates generated UI as it streams.
• Fixes malformed output and schema violations on the fly.
• Recovers from model or provider failures using fallbacks.

In production data from our Reliability benchmark, OpenUI Cloud fixed 96% of generations that initially failed validation.

Integrations options

OpenUI Cloud provides two OpenAI-compatible APIs for this generation flow:

• Chat Completions: A drop-in endpoint for applications that already use the OpenAI Chat Completions API for generative UI.
• Responses API: Build stateful model interactions that continue from previous responses, with built-in persistence and hosted tools such as web search, image search, presentation generation, and more.

Learn more in the OpenUI Cloud documentation.