tkmind/tkmind_go
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

Docs: Auto-compact context (#4116)

Browse Source
This commit is contained in:
Emma Youndtsmith
2025-08-18 09:30:07 -05:00
committed by GitHub
parent ccbf3f96be
commit 62083c8058
3 changed files with 70 additions and 57 deletions
Download Patch File Download Diff File Expand all files Collapse all files
documentation/docs/guides/config-file.md
+1
View File
@@ -35,6 +35,7 @@ The following settings can be configured at the root level of your config.yaml f
| `GOOSE_CLI_SHOW_COST` | Show estimated cost for token use in the CLI | true/false | false | No | | `GOOSE_CLI_SHOW_COST` | Show estimated cost for token use in the CLI | true/false | false | No |
| `GOOSE_ALLOWLIST` | URL for allowed extensions | Valid URL | None | No | | `GOOSE_ALLOWLIST` | URL for allowed extensions | Valid URL | None | No |
| `GOOSE_RECIPE_GITHUB_REPO` | GitHub repository for recipes | Format: "org/repo" | None | No | | `GOOSE_RECIPE_GITHUB_REPO` | GitHub repository for recipes | Format: "org/repo" | None | No |
| `GOOSE_AUTO_COMPACT_THRESHOLD` | Set the percentage threshold at which Goose [automatically summarizes your session](/docs/guides/smart-context-management.md#automatic-compaction). | Float between 0.0 and 1.0 (disabled at 0.0)| 0.8 | No |
## Experimental Features ## Experimental Features
documentation/docs/guides/environment-variables.md
+4
View File
@@ -113,6 +113,7 @@ These variables control how Goose manages conversation sessions and context.
| `GOOSE_TEMPORAL_BIN` | Optional custom path to your Temporal binary | /path/to/temporal-service | None | | `GOOSE_TEMPORAL_BIN` | Optional custom path to your Temporal binary | /path/to/temporal-service | None |
| `GOOSE_RANDOM_THINKING_MESSAGES` | Controls whether to show amusing random messages during processing | "true", "false" | "true" | | `GOOSE_RANDOM_THINKING_MESSAGES` | Controls whether to show amusing random messages during processing | "true", "false" | "true" |
| `GOOSE_CLI_SHOW_COST` | Toggles display of model cost estimates in CLI output | "true", "1" (case insensitive) to enable | false | | `GOOSE_CLI_SHOW_COST` | Toggles display of model cost estimates in CLI output | "true", "1" (case insensitive) to enable | false |
| `GOOSE_AUTO_COMPACT_THRESHOLD` | Set the percentage threshold at which Goose [automatically summarizes your session](/docs/guides/smart-context-management.md#automatic-compaction). | Float between 0.0 and 1.0 (disabled at 0.0) | 0.8 |
**Examples** **Examples**
@@ -149,6 +150,9 @@ export GOOSE_RANDOM_THINKING_MESSAGES=false
# Enable model cost display in CLI # Enable model cost display in CLI
export GOOSE_CLI_SHOW_COST=true export GOOSE_CLI_SHOW_COST=true
# Automatically compact sessions when 60% of available tokens are used
export GOOSE_AUTO_COMPACT_THRESHOLD=0.6
``` ```
### Model Context Limit Overrides ### Model Context Limit Overrides
documentation/docs/guides/smart-context-management.md
+65 -57
View File
@@ -16,50 +16,80 @@ When working with [Large Language Models (LLMs)](/docs/getting-started/providers
- **Context Management**: How Goose handles conversations approaching these limits - **Context Management**: How Goose handles conversations approaching these limits
- **Turn**: One complete prompt-response interaction between Goose and the LLM - **Turn**: One complete prompt-response interaction between Goose and the LLM
## Context Limit Strategy ## How Goose Manages Context
Goose uses a two-tierd approach to context management:
When a conversation reaches the context limit, Goose offers different ways to handle it: 1. **Auto-Compaction**: Proactively summarizes conversation when approaching token limits
2. **Context Strategies**: Backup strategy used if the context limit is still exceeded after auto-compaction
| Feature | Description | Best For | Impact | This layered approach lets Goose handle token and context limits gracefully.
|---------|-------------|-----------|---------|
| **Summarization** | Condenses conversation while preserving key points | Long, complex conversations | Maintains most context |
| **Truncation** | Removes oldest messages to make room | Simple, linear conversations | Loses old context |
| **Clear** | Starts fresh while keeping session active | New direction in conversation | Loses all context |
| **Prompt** | Asks user to choose from the above options | Control over each decision in interactive sessions | Depends on choice made |
Your available options depend on whether you're using the Desktop app or CLI. ## Automatic Compaction
Goose automatically compacts (summarizes) older parts of your conversation when approaching token limits, allowing you to maintain long-running sessions without manual intervention.
Auto-compaction is triggered by default when you reach 80% of the token limit in Goose Desktop and the Goose CLI.
Control the auto-compaction behavior with the `GOOSE_AUTO_COMPACT_THRESHOLD` [environment variable](/docs/guides/environment-variables.md#session-management).
Disable this feature by setting the value to `0.0`.
```
# Automatically compact sessions when 60% of available tokens are used
export GOOSE_AUTO_COMPACT_THRESHOLD=0.6
```
When you reach the auto-compaction threshold:
1. Goose will automatically start summarizing the conversation to make room.
2. You'll see a message that says **"Auto-compacted context: X → Y tokens (Z% reduction)"**
3. Once complete, previous messages in your conversation remain visible, but only the summary is included in the active context for Goose.
4. Continue the session with the summarized context in place.
### Manual Compaction
You can also trigger compaction manually before reaching context or token limits:
<Tabs groupId="interface">
<TabItem value="ui" label="Goose Desktop" default>
1. Click the scroll text icon <ScrollText className="inline" size={16} /> in the chat interface
2. Confirm the summarization in the modal
3. View or edit the generated summary if needed
:::note
Before the scroll icon appears, you must send at least one message in the chat. Simply starting a new session won't trigger it.
:::
</TabItem>
<TabItem value="cli" label="Goose CLI" default>
To proactively trigger summarization before reaching context limits, use the `/summarize` command:
```sh
( O)> /summarize
◇ Are you sure you want to summarize this conversation? This will condense the message history.
│ Yes
│
Summarizing conversation...
Conversation has been summarized.
Key information has been preserved while reducing context length.
```
</TabItem>
</Tabs>
## Context Limit Strategies
When auto-compaction is disabled, or if a conversation still exceeds the context limit, Goose offers different ways to handle it:
| Feature | Description | Best For | Availability | Impact |
|---------|-------------|-----------|-----------|---------|
| **Summarization** | Condenses conversation while preserving key points | Long, complex conversations | Desktop and CLI | Maintains most context |
| **Truncation** | Removes oldest messages to make room | Simple, linear conversations | CLI only | Loses old context |
| **Clear** | Starts fresh while keeping session active | New direction in conversation | CLI only | Loses all context |
| **Prompt** | Asks user to choose from the above options | Control over each decision in interactive sessions | CLI only | Depends on choice made |
<Tabs groupId="interface"> <Tabs groupId="interface">
<TabItem value="ui" label="Goose Desktop" default> <TabItem value="ui" label="Goose Desktop" default>
Goose Desktop exclusively uses summarization to manage context, preserving key information while reducing size. Goose Desktop exclusively uses summarization to manage context, preserving key information while reducing size.
<Tabs>
<TabItem value="automatic" label="Automatic" default>
When you reach the context limit in Goose Desktop:
1. Goose will automatically start summarizing the conversation to make room.
2. You'll see a message that says **"Preparing summary..."**, followed by **"Session summarized."**
3. Once complete, you'll have the option to **"View or edit summary."**
4. You can then continue the session with the summarized context in place.
</TabItem>
<TabItem value="manual" label="Manual">
You can proactively summarize your conversation before reaching context limits:
1. Click the scroll text icon <ScrollText className="inline" size={16} /> in the chat interface
2. Confirm the summarization in the modal
3. View or edit the generated summary if needed
:::note
Before the scroll icon appears, you must send at least one message in the chat. Simply starting a new session won't trigger it.
:::
</TabItem>
</Tabs>
</TabItem> </TabItem>
<TabItem value="cli" label="Goose CLI"> <TabItem value="cli" label="Goose CLI">
@@ -81,9 +111,6 @@ export GOOSE_CONTEXT_STRATEGY=clear # Automatically clear session
export GOOSE_CONTEXT_STRATEGY=prompt export GOOSE_CONTEXT_STRATEGY=prompt
``` ```
<Tabs>
<TabItem value="automatic" label="Automatic" default>
When you hit the context limit, the behavior depends on your configuration: When you hit the context limit, the behavior depends on your configuration:
**With default settings (no `GOOSE_CONTEXT_STRATEGY` set)**, you'll see this prompt to choose a management option: **With default settings (no `GOOSE_CONTEXT_STRATEGY` set)**, you'll see this prompt to choose a management option:
@@ -120,25 +147,6 @@ Goose tried its best to truncate messages for you.
Context maxed out - automatically cleared session. Context maxed out - automatically cleared session.
-------------------------------------------------- --------------------------------------------------
``` ```
</TabItem>
<TabItem value="manual" label="Manual">
To proactively trigger summarization before reaching context limits, use the `/summarize` command:
```sh
( O)> /summarize
◇ Are you sure you want to summarize this conversation? This will condense the message history.
│ Yes
│
Summarizing conversation...
Conversation has been summarized.
Key information has been preserved while reducing context length.
```
</TabItem>
</Tabs>
</TabItem> </TabItem>
</Tabs> </Tabs>