pyVideoTrans

v4.08 ChangeLog

• 修复未选配音时字幕可能为空问题
• 优化单视频模式下字幕编辑/重新配音
• 优化 whisper.cpp 渠道，Windows版内置
• 优化模型下载
• 优化UI界面
• 批量翻译视频时，增加删除某个任务按钮

---

v4.08 完整包下载(2.7G)

• 百度网盘地址: https://pan.baidu.com/s/1Nqtf_5l9BxGo3BZyOu5UQA?pwd=1234
• huggingface.co: https://huggingface.co/mortimerme/repocollect/resolve/main/win-pyvideotrans-v4.08-0802.7z?download=true

v4.08 补丁包下载(300MB)

补丁包不可单独使用，仅用于覆盖旧包, 覆盖后如果闪退，请下载完整包. 如果补丁包覆盖后报错，建议下载完整包。

• 百度网盘地址: https://pan.baidu.com/s/1kvhKdyZPKg-mUIXKT6LtAQ?pwd=1234
• huggingface.co: https://huggingface.co/mortimerme/repocollect/resolve/main/win-PatchUpdate-v4.08-0802.7z?download=true

---

Full Changelog: https://github.com/jianchang512/pyvideotrans/compare/v4.07...v4.08

Sponsors: Recall.ai - Meeting Transcription API

If you’re looking for a transcription API for meetings, consider checking out Recall.ai , an API that works with Zoom, Google Meet, Microsoft Teams, and more

---

pyVideoTrans

<div align="center">

A Powerful Open Source Video Translation / Audio Transcription / AI Dubbing / Subtitle Translation Tool

中文 | Documentation | Online Q&A

License Python [Platform]()

</div>

pyVideoTrans is dedicated to seamlessly converting videos from one language to another, offering a complete workflow that includes speech recognition, subtitle translation, multi-role dubbing, and audio-video synchronization. It supports both local offline deployment and a wide variety of mainstream online APIs.

<img width="1730" height="957" alt="image" src="https://github.com/user-attachments/assets/25d78661-8b73-4f34-a3e5-205c7daba99b" />

---

✨ Core Features

Technical Architecture and Principles

• 🎥 Fully Automatic Video Translation: One-click workflow: Speech Recognition (ASR) → Subtitle Translation → Speech Synthesis (TTS) → Video Synthesis.
• 🎙️ Audio Transcription / Subtitle Generation: Batch convert audio/video to SRT subtitles, supporting Speaker Diarization to distinguish between different roles.
• 🗣️ Multi-Role AI Dubbing: Assign different AI dubbing voices to different speakers.
• 🧬 Voice Cloning: Integrates models like F5-TTS, CosyVoice, GPT-SoVITS for zero-shot voice cloning.
• 🧠 Powerful Model Support:
• ASR: Faster-Whisper (Local), OpenAI Whisper, Alibaba Qwen, ByteDance Volcano, Azure, Google, etc.
• LLM Translation: DeepSeek, ChatGPT, Claude, Gemini, MiniMax, Ollama (Local), Alibaba Bailian, etc.
• TTS: Edge-TTS (Free), OpenAI, Azure, Minimaxi, ChatTTS, ChatterBox, etc.
• 🖥️ Interactive Editing: Supports pausing and manual proofreading at each stage (recognition, translation, dubbing) to ensure accuracy.
• 🛠️ Utility Toolkit: Includes auxiliary tools such as vocal separation, video/subtitle merging, audio-video alignment, and transcript matching.
• 💻 Command Line Interface (CLI): Supports headless operation, convenient for server deployment or batch processing.
• 🌐 Web Interface (WebUI): Browser-based interface for remote access or internal network deployment.

---

🚀 Quick Start (Windows Users)

We provide a pre-packaged .exe version for Windows 10/11 users, requiring no Python environment configuration.

1. Download: Click to download the latest pre-packaged version
2. Unzip: Extract the compressed file to a path without Chinese characters or spaces (e.g., D:\pyVideoTrans).
3. Run: Double-click sp.exe inside the folder to launch.

Note:

* Do not run directly from within the compressed archive.

* To use GPU acceleration, ensure CUDA 12.8 and cuDNN 9.11 are installed.

---

🛠️ Source Deployment (macOS / Linux / Windows Developers)

We recommend using uv for package management for faster speed and better environment isolation.

1. Prerequisites

• Python: Recommended version 3.10
• FFmpeg: Must be installed and configured in the environment variables.
• macOS:

    brew install libsndfile  git  python@3.10

	brew uninstall --ignore-dependencies ffmpeg

	brew tap homebrew-ffmpeg/ffmpeg

	brew install homebrew-ffmpeg/ffmpeg/ffmpeg

• Linux (Ubuntu/Debian): sudo apt-get install ffmpeg libsndfile1-dev
• Windows: Download FFmpeg and configure Path, or place ffmpeg.exe and ffprobe.exe directly in the project directory.

2. Install uv (If not installed)

# macOS/Linux
curl -LsSf https://astral.sh/uv/install.sh | sh

# Windows (PowerShell)
powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"

3. Clone and Install

git clone https://github.com/jianchang512/pyvideotrans.git
cd pyvideotrans
uv sync

By default, whisper.net and WebUI are not installed locally.

- To install all optional channels: uv sync --all-extras

- To install whisper.net: uv sync --extra dotnet

- To install WebUI: uv sync --extra webui

4. Launch Software

GUI:

uv run sp.py

CLI:

# Video Translation
uv run cli.py --task vtv --name "./video.mp4" --source_language_code zh-cn --target_language_code en --voice_role "en-US-GuyNeural"

# Audio to Subtitle
uv run cli.py --task stt --name "./audio.wav" --model_name large-v3

# Subtitle Translation
uv run cli.py --task sts --name "./subs.srt" --target_language_code en

# Text to Speech
uv run cli.py --task tts --name "./subs.srt" --voice_role "zh-CN-YunyangNeural"

CLI documentation with all parameters

WebUI (for remote/internal network access):

uv sync --extra webui
uv run webui.py

Docker (containerized deployment):

# Build
docker build -t pyvideotrans-webui .

# Run
docker run -d -p 7860:7860 --name pyvideotrans pyvideotrans-webui

# With persistent config and output
docker run -d -p 7860:7860 \
  -v ./data/output:/app/output \
  -v ./data/config:/app/videotrans \
  --name pyvideotrans pyvideotrans-webui

WebUI documentation

5. (Optional) GPU Acceleration Configuration

If you have an NVIDIA graphics card, execute the following commands to install the CUDA-supported PyTorch version:

# Uninstall CPU version
uv remove torch torchaudio

# Install CUDA version (Example for CUDA 12.x)
uv add torch==2.7 torchaudio==2.7 --index-url https://download.pytorch.org/whl/cu128
uv add nvidia-cublas-cu12 nvidia-cudnn-cu12

AMD GPU acceleration via Whisper.NET

---

🧩 Supported Channels & Models (Partial)

| Category | Channel/Model | Description |

| :--- | :--- | :--- |

| ASR (Speech Recognition) | Faster-Whisper (Local) | Recommended, fast speed, high accuracy |

| | WhisperX / Parakeet | Supports timestamp alignment & speaker diarization |

| | Alibaba Qwen3-ASR / ByteDance Volcano | Online API, excellent for Chinese |

| Translation (LLM/MT) | DeepSeek / ChatGPT | Supports context understanding, more natural translation |

| | MiniMax AI | MiniMax M3 LLM, latest flagship model, OpenAI-compatible |

| | Google / Microsoft | Traditional machine translation, fast speed |

| | Ollama / M2M100 | Fully local offline translation |

| TTS (Speech Synthesis) | Edge-TTS | Microsoft free interface, natural effect |

| | F5-TTS / CosyVoice | Supports Voice Cloning, requires local deployment |

| | GPT-SoVITS / ChatTTS | High-quality open-source TTS |

| | 302.AI / OpenAI / Azure | High-quality commercial API |

---

📚 Documentation & Support

• Official Documentation: https://pyvideotrans.com (Includes detailed tutorials, API configuration guides, FAQ)
• Online Q&A Community: https://bbs.pyvideotrans.com (Submit error logs for automated AI analysis and answers)
• GitHub Wiki: architecture.md | cli.md | webui.md | Synchronize.md | faq.md

⚠️ Disclaimer

This software is an open-source, free, non-commercial project. Users are solely responsible for any legal consequences arising from the use of this software (including but not limited to calling third-party APIs or processing copyrighted video content). Please comply with local laws and regulations and the terms of use of relevant service providers.

🙏 Acknowledgements

This project mainly relies on the following open-source projects (partial):

• FFmpeg
• PySide6
• sherpa-onnx
• faster-whisper
• openai-whisper
• edge-tts
• F5-TTS
• Confucius4-TTS
• OmniVoice
• CosyVoice
• Gradio (WebUI)

---

Created by jianchang512