-
Notifications
You must be signed in to change notification settings - Fork 1.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
AI-4795 Coverage for ray_vllm* metrics #19358
base: master
Are you sure you want to change the base?
Conversation
The changelog type |
The changelog type |
The changelog type |
Co-authored-by: Kyle Neale <[email protected]>
What does this PR do?
ray_vllm:
for when vllm is run as a libraryray_vllm:
metrics are collectedMotivation
Review checklist (to be filled by reviewers)
qa/skip-qa
label if the PR doesn't need to be tested during QA.backport/<branch-name>
label to the PR and it will automatically open a backport PR once this one is merged