From 32331051315b5e1ebb21403dc1fe235f301c6c19 Mon Sep 17 00:00:00 2001 From: iProbe Date: Thu, 25 Jan 2024 16:13:25 +0800 Subject: [PATCH] =?UTF-8?q?=E6=B7=BB=E5=8A=A0=20Others/=E6=A0=B9=E6=8D=AEg?= =?UTF-8?q?pu=E4=BD=BF=E7=94=A8=E7=8E=87=E8=B0=83=E5=BA=A6/readme.md?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- Others/根据gpu使用率调度/readme.md | 3 +++ 1 file changed, 3 insertions(+) create mode 100644 Others/根据gpu使用率调度/readme.md diff --git a/Others/根据gpu使用率调度/readme.md b/Others/根据gpu使用率调度/readme.md new file mode 100644 index 0000000..7980f52 --- /dev/null +++ b/Others/根据gpu使用率调度/readme.md @@ -0,0 +1,3 @@ +## 思路： +1.使用python获取gpu使用率，推送绑定gpu的大模型副本链接及使用率到redis +2.使用openresty+lua，获取redis中的最合适副本链接 \ No newline at end of file