In-depth Diagnosis: The Trace-Panel
The Trace-Panel is the central analysis tool in Ontheia. It provides deep insight into how the AI works by bundling information from memory, executed tools, and technical system events in one place.
Activation
Section titled “Activation”The Trace-Panel is controlled via the Eye Icon at the top right of the chat window.
- Show: Click the icon to open the diagnostic details for the current chat.
- Hide: Clicking again closes the panel to refocus on the conversation.
- Automatic Reset: When switching between different chats, the panel is automatically closed for privacy reasons.
Structure & Tabs
Section titled “Structure & Tabs”The panel is divided into four specialized areas:
1. Memory
Section titled “1. Memory”All information that the agent has retrieved from long-term memory is listed here.
- Preview: Entries are initially displayed compactly (max. 5 lines).
- Details: The “Show All” button can be used to display the full context of an entry.
- Relevance: What the entry is worth for this question — the similarity after namespace bonus and recency. The value can exceed 1. When the raw similarity differs, it is shown next to it.
- Origin: A delegated step assembles its own context, with its own
top_k. Hits that only appeared there carry the sub-agent’s name; a leading+means the hit was in the main run’s context as well. No label means it came from the main run alone — the ordinary case. Without this the list reads as one context when it was several. - Once per entry: if the same entry is injected and then found again by a search, it still occupies a single row.
2. Tools
Section titled “2. Tools”Track every action the agent has performed via MCP servers (Model Context Protocol).
- Live & History: The panel shows both the tool calls of the current Run and all past actions of this chat.
- Transparency: You see the exact arguments sent to the tool, as well as the result or error messages from the server.
- Status Indicators: Color dots immediately signal success (Green), ongoing processes (Yellow), or errors (Red).
3. Reasoning
Section titled “3. Reasoning”Shows the model’s intermediate thoughts, provided the provider exposes them (e.g. Anthropic Extended Thinking or the reasoning summaries of the OpenAI Responses API).
- Origin: Each entry is labeled with the agent that produced it. For delegated runs the respective sub-agent’s label appears; otherwise “Reasoning”.
- Preview & Details: Longer chains of thought are truncated to five lines and can be expanded in full via “Show more”.
- Withheld Content: If the provider releases only parts of the reasoning, an italic note points this out.
- Prerequisite: A reasoning effort must be set on the model.
- Summary, not raw text: The OpenAI Responses API never exposes the actual chain of thought — it returns a recap the model writes about its own reasoning (a “summary”, usually with a bold heading). Anthropic returns the thinking text directly.
- Empty tab despite a thinking phase: OpenAI produces such a summary only sporadically, and not in proportion to the effort: a run with 390 reasoning tokens may return none while one with 44 tokens returns one. When the model demonstrably reasoned but no summary arrived, the tab reports the token count, so “did not think” can be told apart from “the provider withheld it”. Anthropic and xAI fill the tab reliably.
4. Events (Chain of Events)
Section titled “4. Events (Chain of Events)”The chronological list of all technical background events of a Run.
- Timing: Timestamps for the start of the request, receipt of tokens, and completion.
- Provider Retries: If a request to the provider fails transiently (network blip or HTTP 429/5xx), a
provider_retrywarning appears with the actual error cause. The run is retried automatically up to twice instead of discarding the work already done. - JSON Deep Dive: For experts, the raw data of each event can be expanded individually.
Exporting JSON
Section titled “Exporting JSON”The “Copy JSON” button at the top of the panel copies the entire trace as JSON to the clipboard. The menu offers two variants:
- Copy without reasoning: Exports the trace without the model’s internal thought processes — suitable for sharing and bug reports.
- Copy with reasoning: Additionally includes the full reasoning entries.
Why Use the Trace-Panel?
Section titled “Why Use the Trace-Panel?”The Trace-Panel helps you see through the AI’s “black box.” It is essential for understanding the factual basis on which the agent responds, why it chooses certain tools, or where a complex workflow (Chain) is stalling.