更新MuseTalk的部署

This commit is contained in:
Kevin Wong
2026-01-15 15:50:23 +08:00
parent fcc1a99778
commit 30a7677837
2 changed files with 90 additions and 156 deletions

View File

@@ -69,55 +69,20 @@ playwright install chromium
---
## 步骤 4: 安装 MMPose (唇形检测)
## 步骤 4: 部署 AI 模型 (MuseTalk)
```bash
source /home/rongye/ProgramFiles/ViGent/backend/venv/bin/activate
> ⚠️ **重要**MuseTalk 需要独立的 Conda 环境和特定的 PyTorch 版本。请**不要**直接安装在后端环境中。
pip install -U openmim
mim install mmengine
mim install "mmcv>=2.0.1"
mim install "mmdet>=3.1.0"
mim install "mmpose>=1.1.0"
```
请参考详细的独立部署指南:
**[MuseTalk 部署指南](../models/MuseTalk/DEPLOY.md)**
---
该指南包含以下关键步骤,请务必严格按照文档操作:
1. 创建独立的 `musetalk` Conda 环境
2. 安装特定版本的 PyTorch (2.0.1) 和 MMLab 依赖
3. 按照特定结构下载模型权重
4. 验证推理脚本
## 步骤 5: 安装 MuseTalk
```bash
cd /home/rongye/ProgramFiles/ViGent/models
# 克隆仓库
git clone https://github.com/TMElyralab/MuseTalk.git
cd MuseTalk
# 激活虚拟环境
source /home/rongye/ProgramFiles/ViGent/backend/venv/bin/activate
# 安装依赖
pip install -r requirements.txt
```
---
## 步骤 6: 下载 MuseTalk 模型权重
从 HuggingFace 下载模型:
- 地址: https://huggingface.co/TMElyralab/MuseTalk
```bash
cd /home/rongye/ProgramFiles/ViGent/models/MuseTalk
# 使用 huggingface-cli 下载 (需要安装 huggingface_hub)
pip install huggingface_hub
huggingface-cli download TMElyralab/MuseTalk --local-dir ./models
```
或手动下载后放到:
```
/home/rongye/ProgramFiles/ViGent/models/MuseTalk/models/
```
确保 MuseTalk 部署成功后,再继续后续步骤。
---