ivape 5 days ago

Darn, don't have the appropriate hardware.

The full version of Dia requires around 10GB of VRAM to run.

If you have a 16gb of VRAM, I guess you could pair this with a 3B param model along side it, or really probably only 1B param with reasonable context window.

1
toebee 5 days ago

We will work on a quantized version of the model, so hopefully you will be able to run it soon!

We've seen Bark from Suno go from 16GB requirement -> 4GB requirement + running on CPUs. Won't be too hard, just need some time to work on it.

ivape 5 days ago

No doubt, these TTS models locally are what I'm looking for because I'm so done typing and reading :)

toebee 5 days ago
ivape 4 days ago

Woah, you guys are on it!