Docs/Others/根据gpu使用率调度/readme.md

3 lines
No EOL
170 B
Markdown
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

## 思路:
1.使用python获取gpu使用率推送绑定gpu的大模型副本链接及使用率到redis
2.使用openresty+lua获取redis中的最合适副本链接