Hugging Face's logo

qualcomm
/
MeloTTS-EN

Text-to-Audio
PyTorch
real_time
android
Model card Files
xet
 Community

MeloTTS-EN: Optimized for Qualcomm Devices

MeloTTS is a high-quality multi-lingual text-to-speech library for English, Chinese and Spanish language.

This is based on the implementation of MeloTTS-EN found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Deploying MeloTTS-EN on-device

This model is compatible with the Qualcomm Voice AI SDK. Download the SDK from the Qualcomm Package Manager to deploy this model on-device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
VOICE_AI mixed_with_float Snapdragon® X2 Elite QAIRT 2.45 Download
VOICE_AI mixed_with_float Snapdragon® X Elite QAIRT 2.45 Download
VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile QAIRT 2.45 Download
VOICE_AI mixed_with_float Qualcomm® QCS8275 QAIRT 2.45 Download
VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) QAIRT 2.45 Download
VOICE_AI mixed_with_float Qualcomm® SA8775P QAIRT 2.45 Download
VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile QAIRT 2.45 Download
VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile QAIRT 2.45 Download
VOICE_AI mixed_with_float Qualcomm® SA7255P QAIRT 2.45 Download
VOICE_AI mixed_with_float Qualcomm® QCS9075 QAIRT 2.45 Download

For more device-specific assets and performance metrics, visit MeloTTS-EN on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for MeloTTS-EN on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.audio_generation

Model Stats:

  • Model checkpoint: myshell-ai/MeloTTS-English
  • Max decoded sequence length: 512 tokens
  • Number of parameters (encoder): 8.30M
  • Model size (encoder) (float): 31.8 MB
  • Number of parameters (flow): 20.1M
  • Model size (flow) (float): 76.9 MB
  • Number of parameters (decoder): 14.5M
  • Model size (decoder) (float): 55.5 MB
  • Number of parameters (bert_wrapper): 94.5M
  • Model size (bert_wrapper) (float): 360 MB
  • Number of parameters (t5_encoder): 15.1M
  • Model size (t5_encoder) (float): 57.5 MB
  • Number of parameters (t5_decoder): 5.72M
  • Model size (t5_decoder) (float): 21.8 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
bert_wrapper VOICE_AI mixed_with_float Snapdragon® X2 Elite 3.268 ms 0 - 0 MB NPU
bert_wrapper VOICE_AI mixed_with_float Snapdragon® X Elite 7.69 ms 0 - 0 MB NPU
bert_wrapper VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile 5.025 ms 0 - 7 MB NPU
bert_wrapper VOICE_AI mixed_with_float Qualcomm® QCS8275 30.66 ms 0 - 7 MB NPU
bert_wrapper VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) 7.076 ms 0 - 1 MB NPU
bert_wrapper VOICE_AI mixed_with_float Qualcomm® QCS9075 9.005 ms 2 - 4 MB NPU
bert_wrapper VOICE_AI mixed_with_float Qualcomm® SA7255P 30.66 ms 0 - 7 MB NPU
bert_wrapper VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile 3.326 ms 0 - 13 MB NPU
bert_wrapper VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 2.687 ms 0 - 9 MB NPU
bert_wrapper VOICE_AI mixed_with_float Qualcomm® QCS8750 3.326 ms 0 - 13 MB NPU
bert_wrapper VOICE_AI mixed_with_float Qualcomm® QCS7181 7.69 ms 0 - 0 MB NPU
decoder VOICE_AI mixed_with_float Snapdragon® X2 Elite 40.994 ms 1 - 1 MB NPU
decoder VOICE_AI mixed_with_float Snapdragon® X Elite 82.733 ms 0 - 0 MB NPU
decoder VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile 61.251 ms 1 - 8 MB NPU
decoder VOICE_AI mixed_with_float Qualcomm® QCS8275 134.687 ms 0 - 10 MB NPU
decoder VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) 86.739 ms 1 - 3 MB NPU
decoder VOICE_AI mixed_with_float Qualcomm® QCS9075 82.874 ms 0 - 2 MB NPU
decoder VOICE_AI mixed_with_float Qualcomm® SA7255P 134.687 ms 0 - 10 MB NPU
decoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile 48.27 ms 0 - 13 MB NPU
decoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 42.317 ms 0 - 9 MB NPU
decoder VOICE_AI mixed_with_float Qualcomm® QCS8750 48.27 ms 0 - 13 MB NPU
decoder VOICE_AI mixed_with_float Qualcomm® QCS7181 82.733 ms 0 - 0 MB NPU
encoder VOICE_AI mixed_with_float Snapdragon® X2 Elite 25.516 ms 4 - 4 MB NPU
encoder VOICE_AI mixed_with_float Snapdragon® X Elite 40.433 ms 4 - 4 MB NPU
encoder VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile 30.847 ms 4 - 11 MB NPU
encoder VOICE_AI mixed_with_float Qualcomm® QCS8275 66.544 ms 2 - 9 MB NPU
encoder VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) 40.447 ms 4 - 5 MB NPU
encoder VOICE_AI mixed_with_float Qualcomm® QCS9075 43.391 ms 6 - 11 MB NPU
encoder VOICE_AI mixed_with_float Qualcomm® SA7255P 66.544 ms 2 - 9 MB NPU
encoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile 25.217 ms 2 - 15 MB NPU
encoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 23.856 ms 2 - 10 MB NPU
encoder VOICE_AI mixed_with_float Qualcomm® QCS8750 25.217 ms 2 - 15 MB NPU
encoder VOICE_AI mixed_with_float Qualcomm® QCS7181 40.433 ms 4 - 4 MB NPU
flow VOICE_AI mixed_with_float Snapdragon® X2 Elite 67.716 ms 2 - 2 MB NPU
flow VOICE_AI mixed_with_float Snapdragon® X Elite 129.761 ms 2 - 2 MB NPU
flow VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile 99.207 ms 4 - 12 MB NPU
flow VOICE_AI mixed_with_float Qualcomm® QCS8275 245.532 ms 2 - 12 MB NPU
flow VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) 132.616 ms 2 - 4 MB NPU
flow VOICE_AI mixed_with_float Qualcomm® QCS9075 127.86 ms 2 - 6 MB NPU
flow VOICE_AI mixed_with_float Qualcomm® SA7255P 245.532 ms 2 - 12 MB NPU
flow VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile 81.802 ms 2 - 15 MB NPU
flow VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 70.976 ms 2 - 14 MB NPU
flow VOICE_AI mixed_with_float Qualcomm® QCS8750 81.802 ms 2 - 15 MB NPU
flow VOICE_AI mixed_with_float Qualcomm® QCS7181 129.761 ms 2 - 2 MB NPU
t5_decoder VOICE_AI mixed_with_float Snapdragon® X2 Elite 0.31 ms 1 - 1 MB NPU
t5_decoder VOICE_AI mixed_with_float Snapdragon® X Elite 0.448 ms 1 - 1 MB NPU
t5_decoder VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile 0.305 ms 0 - 7 MB NPU
t5_decoder VOICE_AI mixed_with_float Qualcomm® QCS8275 1.012 ms 0 - 9 MB NPU
t5_decoder VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) 0.404 ms 1 - 2 MB NPU
t5_decoder VOICE_AI mixed_with_float Qualcomm® QCS9075 0.521 ms 3 - 5 MB NPU
t5_decoder VOICE_AI mixed_with_float Qualcomm® SA7255P 1.012 ms 0 - 9 MB NPU
t5_decoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile 0.281 ms 0 - 9 MB NPU
t5_decoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 0.261 ms 0 - 9 MB NPU
t5_decoder VOICE_AI mixed_with_float Qualcomm® QCS8750 0.281 ms 0 - 9 MB NPU
t5_decoder VOICE_AI mixed_with_float Qualcomm® QCS7181 0.448 ms 1 - 1 MB NPU
t5_encoder VOICE_AI mixed_with_float Snapdragon® X2 Elite 0.647 ms 0 - 0 MB NPU
t5_encoder VOICE_AI mixed_with_float Snapdragon® X Elite 1.062 ms 0 - 0 MB NPU
t5_encoder VOICE_AI mixed_with_float Snapdragon® 8 Gen 3 Mobile 0.636 ms 0 - 7 MB NPU
t5_encoder VOICE_AI mixed_with_float Qualcomm® QCS8275 2.766 ms 0 - 9 MB NPU
t5_encoder VOICE_AI mixed_with_float Qualcomm® QCS8550 (Proxy) 0.899 ms 0 - 1 MB NPU
t5_encoder VOICE_AI mixed_with_float Qualcomm® QCS9075 1.123 ms 2 - 4 MB NPU
t5_encoder VOICE_AI mixed_with_float Qualcomm® SA7255P 2.766 ms 0 - 9 MB NPU
t5_encoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Mobile 0.521 ms 0 - 13 MB NPU
t5_encoder VOICE_AI mixed_with_float Snapdragon® 8 Elite Gen 5 Mobile 0.487 ms 0 - 9 MB NPU
t5_encoder VOICE_AI mixed_with_float Qualcomm® QCS8750 0.521 ms 0 - 13 MB NPU
t5_encoder VOICE_AI mixed_with_float Qualcomm® QCS7181 1.062 ms 0 - 0 MB NPU

License

  • The license for the original implementation of MeloTTS-EN can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
Text-to-Audio
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support