VideoLingo: Connecting the World, Frame by Frame

🌟 Overview (Try VideoLingo Now! (opens in a new tab))

VideoLingo is an all-in-one video translation, localization, and dubbing tool aimed at generating Netflix-quality subtitles. It eliminates stiff machine translations and multi-line subtitles while adding high-quality dubbing, enabling global knowledge sharing across language barriers.

Key features:

• 🎥 YouTube video download via yt-dlp

• 🎙️ Word-level subtitle recognition with Qwen3-ASR + ForcedAligner

• 📝 NLP and GPT-based subtitle segmentation

• 📚 GPT-generated terminology for coherent translation

• 🔄 3-step direct translation, reflection, and adaptation for professional-level quality

• ✅ Netflix-standard single-line subtitles only

• 🗣️ Dubbing alignment with GPT-SoVITS and other methods

• 🚀 One-click startup and output in Streamlit

• 📝 Detailed logging with progress resumption

Difference from similar projects: Single-line subtitles only, superior translation quality, seamless dubbing experience

🎥 Demo

Language Support

Input Language Support(more to come):

🇺🇸 English 🤩 | 🇷🇺 Russian 😊 | 🇫🇷 French 🤩 | 🇩🇪 German 🤩 | 🇮🇹 Italian 🤩 | 🇪🇸 Spanish 🤩 | 🇯🇵 Japanese 😐 | 🇨🇳 Chinese* 😊

*Local recognition uses Qwen3-ASR (1.7B by default, 0.6B selectable).

Translation supports all languages, while dubbing language depends on the chosen TTS method.

Installation

VideoLingo supports Windows, macOS (Apple Silicon / Intel), and Linux.

Ask your local AI agent 🤖

If your AI agent can operate your computer, tell it:

Install and launch GitHub's Huanshere/VideoLingo on my computer.

Windows: double-click to install 🎉

1. Download Source code (zip) from the latest Release (opens in a new tab), extract it to your Desktop or another folder, and open the folder.
2. Double-click OneKeyStart.bat and keep the window open. On the first run, it automatically installs uv, Python 3.12, app dependencies, and FFmpeg. An internet connection is required.
3. After installation, VideoLingo opens automatically in your browser. Enter your API URL, key, and model in the sidebar to start using it.

Install from source (Windows, macOS, Linux)

git clone https://github.com/Huanshere/VideoLingo.git && cd VideoLingo
uv run start.py

To start it later, run uv run start.py again from the VideoLingo folder.

Docker

For Linux NVIDIA containers, use Docker with a compatible driver and NVIDIA Container Toolkit. The image uses the same Python 3.12 setup; see Docker docs:

docker build -t videolingo .
docker run -d -p 8501:8501 --gpus all videolingo

API

The project supports OpenAI-Like API format and various dubbing interfaces:

• Choose an OpenAI-compatible Chat Completions provider and a model capable of returning structured JSON. Set the API URL, key and model in the sidebar.
• edge-tts, openai-tts, siliconflow-fishtts, fish-tts, GPT-SoVITS

For detailed installation, LLM configuration, and usage instructions, please refer to the documentation: English | 中文

Current Limitations

1. Transcription and word timestamps may be affected by background noise. For videos with loud background music, enable Voice Separation Enhancement: Qwen3-ASR still transcribes the original audio, while the ForcedAligner aligns against the separated vocals. Punctuation is re-attached to aligned words heuristically; in rare cases a word may lose its punctuation.

2. Using weaker models can lead to errors during intermediate processes due to strict JSON format requirements for responses. If this error occurs, please delete the output folder and retry with a different LLM, otherwise repeated execution will read the previous erroneous response causing the same error.

3. The dubbing feature may not be 100% perfect due to differences in speech rates and intonation between languages, as well as the impact of the translation step. However, this project has implemented extensive engineering processing for speech rates to ensure the best possible dubbing results.

4. Multilingual video transcription recognition is only reliable for the main language. Alignment runs with one language per audio window, so text and timing in other languages are not guaranteed.

5. Cannot dub multiple characters separately; recognition does not distinguish speakers.

📄 License

This project is licensed under the Apache 2.0 License. Special thanks to the following open source projects for their contributions:

Qwen3-ASR (opens in a new tab), MLX Audio (opens in a new tab), whisperX (opens in a new tab), yt-dlp (opens in a new tab), json_repair (opens in a new tab), BELLE (opens in a new tab)

📬 Contact Us

• Join our Discord: https://discord.gg/9F2G92CWPp (opens in a new tab)
• Submit Issues (opens in a new tab) or Pull Requests (opens in a new tab) on GitHub
• Follow me on Twitter: @Huanshere (opens in a new tab)
• Email me at: team@videolingo.io

⭐ Star History

(opens in a new tab)

If you find VideoLingo helpful, please give us a ⭐️!