Man2Dev ,
@Man2Dev@fosstodon.org avatar

@karolherbst there's no argument there the project as a whole needs improvements on a lot of things. But as for needing beefy's gpus I wouldn't say it's needed for all cases you can and I have run smaller models on CPU alone with just AVX acceleration on llama.cpp. but as for whisper.cpp the last time I tried it with cpu alone it wasn't at all usable

  • Alle
  • Abonniert
  • Moderiert
  • Favoriten
  • random
  • haupteingang
  • Alle Magazine