nhcarrigan/hikari-desktop
9
0
Fork 0
generated from nhcarrigan/template
Code Issues 9 Pull Requests 36 Actions Releases 22 Activity

fix: review cost/token tracking for non-streaming API fallback after v2.1.77 fix #232

New Issue
Closed
opened 2026-03-20 08:26:30 -07:00 by hikari · 0 comments
hikari commented 2026-03-20 08:26:30 -07:00
Owner
Copy Link
Copy Source

Background

CLI v2.1.77 fixed a bug where cost and token usage were not tracked when the API fell back to non-streaming mode. CLI v2.1.79 further improved the non-streaming fallback path with a 2-minute per-attempt timeout to prevent sessions from hanging indefinitely.

Why It Matters for Hikari Desktop

Hikari Desktop independently tracks cost and token usage from the stream-JSON messages (assistant message usage fields and the final result message usage field). If the CLI was previously not emitting usage events in non-streaming fallback mode, we now need to verify our parser correctly handles whatever format they arrive in post-fix.

Additionally, the new 2-minute per-attempt timeout for non-streaming fallback means we should review our own session watchdog timeout. If a fallback attempt is in progress and Hikari Desktop's stuck-session watchdog fires first, we may incorrectly kill a legitimate slow API response.

We should:

  1. Review the watchdog timeout in wsl_bridge.rs against the new 2-minute-per-attempt fallback timeout
  2. Verify that usage events emitted in non-streaming fallback mode are parsed correctly by our ClaudeMessage deserialisation
  3. Add a test for the non-streaming usage event format if it differs from the streaming format

Acceptance Criteria

  • Watchdog timeout reviewed and adjusted if needed
  • Non-streaming fallback usage events verified to deserialise correctly
  • Tests added for the non-streaming usage event format if it differs

✨ This issue was created with help from Hikari~ 🌸

## Background CLI v2.1.77 fixed a bug where cost and token usage were not tracked when the API fell back to non-streaming mode. CLI v2.1.79 further improved the non-streaming fallback path with a 2-minute per-attempt timeout to prevent sessions from hanging indefinitely. ## Why It Matters for Hikari Desktop Hikari Desktop independently tracks cost and token usage from the stream-JSON messages (`assistant` message `usage` fields and the final `result` message `usage` field). If the CLI was previously not emitting usage events in non-streaming fallback mode, we now need to verify our parser correctly handles whatever format they arrive in post-fix. Additionally, the new 2-minute per-attempt timeout for non-streaming fallback means we should review our own session watchdog timeout. If a fallback attempt is in progress and Hikari Desktop's stuck-session watchdog fires first, we may incorrectly kill a legitimate slow API response. We should: 1. Review the watchdog timeout in `wsl_bridge.rs` against the new 2-minute-per-attempt fallback timeout 2. Verify that usage events emitted in non-streaming fallback mode are parsed correctly by our `ClaudeMessage` deserialisation 3. Add a test for the non-streaming usage event format if it differs from the streaming format ## Acceptance Criteria - [ ] Watchdog timeout reviewed and adjusted if needed - [ ] Non-streaming fallback usage events verified to deserialise correctly - [ ] Tests added for the non-streaming usage event format if it differs ✨ This issue was created with help from Hikari~ 🌸
naomi closed this issue 2026-03-23 14:28:09 -07:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
aspect
code
Concerns the software code in the repository
aspect
dx
Concerns developers' experience with the codebase
aspect
interface
Concerns end-users' experience with the software
aspect
text
Concerns the documentation material in the repository
contribute
good first issue
A great opportunity for a team member to learn a new codebase
contribute
help wanted
Open for anyone on our team to grab.
contribute
staff only
Restricted to our executive leadership.
goal
addition
Addition of new feature
goal
fix
Bug fix
goal
improvement
Improvement to an existing feature
points
1
Very simple issue requiring minimal effort and complexity.
points
13
Extremely complex issue representing major undertakings. Should be broken down into smaller pieces.
points
2
Simple issue that requires a bit more thought or investigation.
points
3
Moderate complexity issue requiring more substantial work.
points
5
Complex issue requiring significant effort and expertise.
points
8
Very complex issue requiring extensive work and deep expertise.
priority
critical
1
Must be fixed ASAP
priority
high
2
Stalls work on the project or its dependents
priority
low
4
Low priority and doesn't need to be rushed
priority
medium
3
Not blocking but should be fixed soon
priority
none
5
No priority, should only be performed when a developer is available
status
awaiting triage
Has not been triaged & therefore, not ready for work
status
blocked
Blocked and therefore not ready for work
status
discarded
Will not be worked on
status
discontinued
Not suitable for work as repo is in maintenance
status
label work required
Needs proper labelling before it can be worked on
status
ready for dev
Ready for work
status
ticket work required
Needs more details before it can be worked on
talk
discussion
Open for discussions and feedback
talk
question
Can be resolved with an answer
time
1 day
Approximately one full day of development work.
time
1-2 weeks
One to two weeks of focused development effort.
time
2-3 days
Two to three days of development effort.
time
4-5 days
Approximately one week of development work.
time
<1 day
Less than one day of focused work. Quick fixes or simple tasks.
time
>2 weeks
More than two weeks of development work. Must be broken down into smaller pieces.
No Label
Milestone
No items
No Milestone
Assignees
Clear assignees
gurkirat hanna (Hanna Rose) hikari (Hikari) minori (Minori) naomi (Naomi Carrigan) rain teklu tim
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: nhcarrigan/hikari-desktop#232
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?