Docs: Manually trigger summarization (#2526)
This commit is contained in:
@@ -6,6 +6,7 @@ sidebar_label: Smart Context Management
|
||||
|
||||
import Tabs from '@theme/Tabs';
|
||||
import TabItem from '@theme/TabItem';
|
||||
import { ScrollText } from 'lucide-react';
|
||||
|
||||
When working with [Large Language Models (LLMs)](/docs/getting-started/providers), there are limits to how much conversation history they can process at once. Goose provides smart context management features to help you maintain productive sessions even when reaching these limits. Here are the key concepts:
|
||||
|
||||
@@ -28,6 +29,11 @@ When a conversation reaches the context limit, Goose offers different ways to ha
|
||||
<Tabs groupId="interface">
|
||||
<TabItem value="ui" label="Goose Desktop" default>
|
||||
|
||||
Goose Desktop exclusively uses summarization to manage context, preserving key information while reducing size.
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="automatic" label="Automatic" default>
|
||||
|
||||
When you reach the context limit in Goose Desktop:
|
||||
|
||||
1. Goose will automatically start summarizing the conversation to make room.
|
||||
@@ -35,15 +41,27 @@ When you reach the context limit in Goose Desktop:
|
||||
3. Once complete, you'll have the option to **"View or edit summary."**
|
||||
4. You can then continue the session with the summarized context in place.
|
||||
|
||||
:::note
|
||||
In Goose Desktop, context management is handled automatically.
|
||||
You won’t see options to `clear` or `truncate` — Goose always uses summarization when the context limit is reached.
|
||||
:::
|
||||
</TabItem>
|
||||
<TabItem value="manual" label="Manual">
|
||||
|
||||
You can proactively summarize your conversation before reaching context limits:
|
||||
|
||||
1. Click the scroll text icon (<ScrollText className="inline" size={16} />) in the chat interface
|
||||
2. Confirm the summarization in the modal
|
||||
3. View or edit the generated summary if needed
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
</TabItem>
|
||||
<TabItem value="cli" label="Goose CLI">
|
||||
|
||||
When you reach the context limit in the CLI, you'll see a prompt like this:
|
||||
The CLI offers three context management options: summarize, truncate, or clear your session.
|
||||
|
||||
<Tabs>
|
||||
<TabItem value="automatic" label="Automatic" default>
|
||||
|
||||
When you hit the context limit, you'll see this prompt to choose a management option, allowing you to continue your session:
|
||||
|
||||
```sh
|
||||
◇ The model's context length is maxed out. You will need to reduce the # msgs. Do you want to?
|
||||
@@ -60,7 +78,23 @@ Context maxed out
|
||||
Goose summarized messages for you.
|
||||
```
|
||||
|
||||
After choosing an option and the context is managed, you can continue your conversation in the same session.
|
||||
</TabItem>
|
||||
<TabItem value="manual" label="Manual">
|
||||
|
||||
To proactively trigger summarization before reaching context limits, use the `/summarize` command:
|
||||
|
||||
```sh
|
||||
( O)> /summarize
|
||||
◇ Are you sure you want to summarize this conversation? This will condense the message history.
|
||||
│ Yes
|
||||
│
|
||||
Summarizing conversation...
|
||||
Conversation has been summarized.
|
||||
Key information has been preserved while reducing context length.
|
||||
```
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
|
||||
</TabItem>
|
||||
</Tabs>
|
||||
Reference in New Issue
Block a user