My Translator

My Translator is a real-time speech translation desktop app built with Tauri. It captures audio directly from your system or microphone, transcribes it, and displays translations in a minimal overlay — with no intermediary server involved.

📖 Installation guides: macOS (EN) · macOS (VI) · Windows (EN) · Windows (VI)

How It Works

                                    ┌── ☁️  Soniox  (text)              ──┐
System Audio / Mic → 16kHz PCM ─────┼── ⚡ OpenAI Realtime (text+🔊)      ─┼─→ Overlay UI
                                    ├── 🌏 Qwen LiveTranslate Flash (text only) │
                                    └── 🖥️  Local MLX  (text, offline)   ─┘
                                                                            ↓ (optional, text engines)
                                                  TTS (Edge / Google / ElevenLabs) → 🔊

Four translation engines, pick what fits your call:

📊 Detailed head-to-head: OpenAI Realtime vs Soniox benchmark — speed, quality, cost, and translation-mechanism comparison from a 5-min real-world test.

Features

📖 Dual Panel View

Two display modes:

• Single (default) — Translation text only, clean and focused
• Dual — Source | Translation side-by-side, each panel scrolls independently

Toggle with the panel button (bottom-right on hover).

🔄 Smart Scroll

Auto-scroll only when you're at the bottom. Scroll up to read old content without being yanked back down.

🔤 Quick Font Size

A- / A+ floating controls (bottom-right on hover). Font size adjustable up to 140px — great for presentations.

🔄 Two-Way Translation

Translate conversations between two languages simultaneously — ideal for bilingual meetings.

• One-way: Source language → Target language (e.g., Japanese → Vietnamese)
• Two-way: Language A ↔ Language B (e.g., Vietnamese ↔ Japanese) — the app detects who is speaking and translates to the other language automatically

Setup for video calls (Zoom, Google Meet, MS Teams):

1. Audio Source: Both (System + Mic)
2. Translation Type: Two-way
3. Set Language A and Language B

Note: TTS narration is automatically disabled in two-way mode to prevent audio feedback loops (TTS output → mic recapture → re-translation).

🎙️ TTS Narration

Read translations aloud in one-way mode — 3 providers:

TTS is OFF by default — toggle with the TTS button or ⌘ T.

📖 TTS guide: English · Tiếng Việt

📖 Custom Translation Terms

Define how domain-specific words should be translated:

Original sin = Tội nguyên tổ
Christ = Kitô
Pneumonia = Viêm phổi

Add terms in Settings → Translation → Translation terms. Great for religious, medical, or technical content.

⚡ OpenAI Realtime Mode

Single-call streaming translation via OpenAI's gpt-realtime-translate (May 2026 GA). Returns translated text and translated speech audio over one WebSocket — no separate TTS step, lower end-to-end latency, more idiomatic output. Trade-off: ~$4/hr, charged to your own OpenAI account. 13 target languages: en, es, pt, fr, de, it, ru, hi, id, vi, ja, ko, zh.

Two-way mode and the custom TTS toggle are unavailable while OpenAI Realtime is selected (audio is native).

🌏 Qwen LiveTranslate Flash Mode

Alibaba DashScope qwen3-livetranslate-flash-realtime — streams translated text (no native voice) on Qwen's free preview tier, with a 60-language picker matching the mobile app. Server-side VAD handles turn detection, so it works with mic / system audio / both. Translation-only display (no source-transcript panel; the model doesn't expose ASR). Get a key from Alibaba Cloud Bailian (Singapore region only — other regions hit a different endpoint and fail).

Source language must be picked explicitly (auto-detect is disabled on this engine — Live Flash stalls on real mic input when source is "auto"). Two-way mode and the custom TTS toggle are also disabled while Qwen is selected.

🖥️ Local Mode (Apple Silicon only)

Experimental offline mode using MLX + Whisper + Gemma — runs 100% on-device. JA/EN/ZH/KO → VI/EN.

Privacy

Your audio never touches our servers — because there are none.

• App connects directly to APIs you configure — no relay, no middleman
• You own your API keys — stored locally, never transmitted elsewhere
• No account, no telemetry, no analytics — zero tracking
• Transcripts saved as .md files locally, per session

Tech Stack

• Tauri 2 — Rust backend + WebView frontend
• ScreenCaptureKit — macOS system audio
• WASAPI — Windows system audio
• cpal — Cross-platform microphone
• Soniox — Real-time STT + translation
• OpenAI Realtime Translate — gpt-realtime-translate (text + native voice)
• MLX — On-device Whisper + Gemma for offline mode
• Edge TTS — Free neural TTS (default)
• Google Cloud TTS — Chirp 3 HD (near-human quality)
• ElevenLabs — Premium TTS

Build from Source

git clone https://github.com/phuc-nt/my-translator.git
cd my-translator
npm install
npm run tauri build

Requires: Rust (stable), Node.js 18+, macOS 13+ or Windows 10+.

Star History

License

MIT