Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add large prompt warning to AI request #4183

Closed
justinrobots opened this issue Mar 28, 2025 · 1 comment
Closed

Add large prompt warning to AI request #4183

justinrobots opened this issue Mar 28, 2025 · 1 comment
Assignees
@eamodio
Labels
area-ai Issues or features related to AI needs-verification Request for verification pending-release Resolved but not yet released to the stable edition
Milestone
17.0-patch

Comments

@justinrobots
Copy link
Collaborator

justinrobots commented Mar 28, 2025 •
edited by eamodio
Loading

If an AI request is beyond a token threshold (configurable), then show a warning message

Also if an AI event is large enough to trigger a warning about potentially exceeding token limits, capture the details in the AI telemetry event.

  • was a warning shown?
  • what was the threshold for the warning set to?
  • did the user proceed or cancel?
@justinrobots justinrobots added the triage Needs to be looked at label Mar 28, 2025
@justinrobots justinrobots added this to the 17.1 milestone Mar 28, 2025
@eamodio eamodio modified the milestones: 17.1, 17.0-patch Apr 1, 2025
@eamodio eamodio added area-ai Issues or features related to AI and removed triage Needs to be looked at labels Apr 1, 2025
@eamodio eamodio self-assigned this Apr 1, 2025
@eamodio eamodio changed the title Capture AI limit message activity in telemetry Add large prompt warning to AI request Apr 2, 2025
@eamodio
Copy link
Member

eamodio commented Apr 2, 2025

Added a gitlens.ai.largePromptWarningThreshold setting which defaults to 20K tokens to control this.

@eamodio eamodio closed this as completed in bae7538 Apr 2, 2025
@github-actions github-actions bot added needs-verification Request for verification pending-release Resolved but not yet released to the stable edition labels Apr 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@eamodio eamodio

Labels
area-ai Issues or features related to AI needs-verification Request for verification pending-release Resolved but not yet released to the stable edition
Projects
None yet
Milestone
17.0-patch
Development

No branches or pull requests
2 participants
@eamodio @justinrobots