Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Advanced Paste: Switch from gpt-4o to gpt-4o-mini #36815

Open
DeeQay opened this issue Jan 11, 2025 · 0 comments
Open

Advanced Paste: Switch from gpt-4o to gpt-4o-mini #36815

DeeQay opened this issue Jan 11, 2025 · 0 comments
Labels
Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams

Comments

@DeeQay
Copy link

DeeQay commented Jan 11, 2025

Description of the new feature / enhancement

Summary:
Switching from GPT-4o to GPT-4o Mini in the Advanced Paste feature can save 94% on input tokens and 16.7x cheaper output tokens, with minimal performance difference. MMLU benchmark: 82% (GPT-4o Mini) vs. 88.7% (GPT-4o).


Change:

  • File: src/modules/AdvancedPaste/AdvancedPaste/Services/OpenAI/KernelService.cs
  • Line: 19
  • Update: Change ModelName from "gpt-4o" to "gpt-4o-mini"
protected override string ModelName => "gpt-4o-mini";

Benefits

Cost savings with negligible performance impact.

Supporting information

openAI pricing
GPT4o Mini benchmarks

@DeeQay DeeQay added the Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams label Jan 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Needs-Triage For issues raised to be triaged and prioritized by internal Microsoft teams
Projects
None yet
Development

No branches or pull requests

1 participant