Skip to content

Conversation

@aashna
Copy link

@aashna aashna commented Feb 10, 2026

Adds an autoMode.routerDecision telemetry event that fires when the router decision fetcher successfully selects a model. This lets us track adoption of the new router model and differentiate between users on the new vs. current router.

Properties logged:

routerUrl — the router API endpoint used
chosenModel — the model selected by the router
predictedLabel — the classification label from the router

Measurements logged:

confidence — router's confidence score
latencyMs — round-trip latency of the routing call

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new GitHub telemetry event emitted when the auto mode router returns a successful routing decision, enabling tracking of router usage and outcomes in the endpoint routing flow.

Changes:

  • Inject ITelemetryService into AutomodeService and RouterDecisionFetcher.
  • Emit autoMode.routerDecision telemetry on successful router decision fetch, including router URL + decision details and confidence/latency measurements.
  • Extend unit tests to validate telemetry emission behavior.

Reviewed changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.

File Description
src/platform/endpoint/node/routerDecisionFetcher.ts Sends autoMode.routerDecision telemetry after a validated successful router response.
src/platform/endpoint/node/automodeService.ts Wires telemetry service into the router decision path via DI and passes it to RouterDecisionFetcher.
src/platform/endpoint/node/test/routerDecisionFetcher.spec.ts Adds unit coverage asserting the telemetry event payload emitted by the fetcher.
src/platform/endpoint/node/test/automodeService.spec.ts Updates constructor usage and adds an integration-style test that telemetry is sent when routing occurs.

@luabud
Copy link
Member

luabud commented Feb 10, 2026

@aashna I think it might be missing a GDPR tag. Something like:

   /* __GDPR__
       "autoMode.routerDecision" : {
           "routerUrl" : { "classification": "SystemMetaData", "purpose": "FeatureInsight" },
           "chosenModel" : { "classification": "SystemMetaData", "purpose": "FeatureInsight" },
           "predictedLabel" : { "classification": "SystemMetaData", "purpose": "FeatureInsight" },
           "confidence" : { "classification": "SystemMetaData", "purpose": "FeatureInsight", "isMeasurement": true },
           "latencyMs" : { "classification": "SystemMetaData", "purpose": "PerformanceAndHealth", "isMeasurement": true }
       }
   */

Here's an example:

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 4 out of 4 changed files in this pull request and generated no new comments.

@aashna
Copy link
Author

aashna commented Feb 10, 2026 via email

@bpasero bpasero assigned lramos15 and unassigned bpasero Feb 11, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants