Go to file
Adolfo Delorenzo 4bd56cbe5b Improve audio handling compatibility
- Add support for different audio data formats
- Ensure proper .wav extension for Whisper compatibility 
- Add file size logging for debugging
- Fix data format conversion between client and server
2025-04-12 01:51:15 -06:00
static Fix real-time interpreter audio processing 2025-04-12 01:50:39 -06:00
templates Add real-time language interpreter feature 2025-04-12 00:39:16 -06:00
venv quasi-final 2025-04-05 11:50:31 -06:00
.gitignore second commit 2025-04-04 13:23:58 -06:00
app.py Improve audio handling compatibility 2025-04-12 01:51:15 -06:00
README.md quasi-final 2025-04-05 11:50:31 -06:00
requirements.txt Add real-time language interpreter feature 2025-04-12 00:39:16 -06:00
setup-script.sh quasi-final 2025-04-05 11:50:31 -06:00
tts_test_output.mp3 quasi-final 2025-04-05 11:50:31 -06:00
tts-debug-script.py quasi-final 2025-04-05 11:50:31 -06:00

Voice Language Translator

A mobile-friendly web application that translates spoken language between multiple languages using:

  • Gemma 3 open-source LLM via Ollama for translation
  • OpenAI Whisper for speech-to-text
  • OpenAI Edge TTS for text-to-speech

Supported Languages

  • Arabic
  • Armenian
  • Azerbaijani
  • English
  • French
  • Georgian
  • Kazakh
  • Mandarin
  • Farsi
  • Portuguese
  • Russian
  • Spanish
  • Turkish
  • Uzbek

Setup Instructions

  1. Install the required Python packages:

    pip install -r requirements.txt
    
  2. Make sure you have Ollama installed and the Gemma 3 model loaded:

    ollama pull gemma3
    
  3. Ensure your OpenAI Edge TTS server is running on port 5050.

  4. Run the application:

    python app.py
    
  5. Open your browser and navigate to:

    http://localhost:8000
    

Usage

  1. Select your source language from the dropdown menu
  2. Press the microphone button and speak
  3. Press the button again to stop recording
  4. Wait for the transcription to complete
  5. Select your target language
  6. Press the "Translate" button
  7. Use the play buttons to hear the original or translated text

Technical Details

  • The app uses Flask for the web server
  • Audio is processed client-side using the MediaRecorder API
  • Whisper for speech recognition with language hints
  • Ollama provides access to the Gemma 3 model for translation
  • OpenAI Edge TTS delivers natural-sounding speech output

Mobile Support

The interface is fully responsive and designed to work well on mobile devices.