Skip to content

Commit acd986e

Browse files
update topic classification def
1 parent 71f4b36 commit acd986e

1 file changed

Lines changed: 20 additions & 0 deletions

File tree

genai/Features/9-token-usage-report.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -116,10 +116,30 @@ The Token Usage Report consists of **six key visualizations**, each providing un
116116
**What it shows:** Table displaying estimated token sizes for topic classification prompts, grouped by planner.
117117

118118
**Why it matters:**
119+
120+
Topic classification is **critical for cost optimization** because it's executed **for every single interaction** in the Atlas Reasoning Engine. Topic resolution happens as the first step of every conversation, making it one of the most frequently executed operations.
121+
122+
**Real-World Impact:**
123+
124+
Consider this example:
125+
- **10 conversations** with an average of **10 interactions** each
126+
- This results in **100 topic classification executions**
127+
- If each classification uses 500 tokens, that's **50,000 tokens** just for topic resolution
128+
- At scale, this multiplies quickly: 100 conversations × 10 interactions = **1,000 executions**
129+
130+
**Cost Implications:**
131+
132+
Because topic classification runs so frequently, even small optimizations can lead to significant cost savings:
133+
- **Reducing scope field size by 50%** can cut topic classification costs in half
134+
- **Optimizing 10 topics** that are used frequently can save thousands of tokens per day
135+
- **Choosing efficient topic definitions** compounds savings across all conversations
136+
137+
**Key Benefits:**
119138
- **Cost Estimation**: Understand token costs for topic classification before deployment
120139
- **Optimization**: Identify topics with large scope fields that consume excessive tokens
121140
- **Capacity Planning**: Plan token budgets per planner based on topic definitions
122141
- **Performance Analysis**: Compare token requirements across different planners
142+
- **Scalability**: Make informed decisions about topic definitions that will scale efficiently
123143

124144
**How to use it:**
125145
- **Identify Optimization Opportunities**: Look for planners with high total token sizes - these may benefit from scope field optimization

0 commit comments

Comments
 (0)