iProbe/Docs
0
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

添加 Others/根据gpu使用率调度/readme.md

Browse source
This commit is contained in:
iProbe 2024-01-25 16:13:25 +08:00
parent a0d8b99096
commit 3233105131
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
Others/根据gpu使用率调度/readme.md Normal file
View file

@ -0,0 +1,3 @@
## 思路：
1.使用python获取gpu使用率，推送绑定gpu的大模型副本链接及使用率到redis
2.使用openresty+lua，获取redis中的最合适副本链接