williamtries , an Random Englisch
@williamtries@floss.social avatar

I just posted a short tutorial on setting up a simple on your running . The LLM (7b alpaca in this case) is not terribly accurate but possibly useful in some cases.

Warning! You phone will get hot. I haven't tested it long enough to know if it will harm your device, but do be careful.

Oh! I have a website now! Wow! My history with websites is hit and miss, so enjoy it while it lasts. I have half a dozen posts in the works already.

https://www.williamtries.ovh/llmonpmos/

karolherbst ,
@karolherbst@chaos.social avatar

@okias @williamtries maybe we should just merge freedreno support at this point, because it's still not upstream?

pocketvj ,
@pocketvj@fosstodon.org avatar

@karolherbst @okias @williamtries
perfect, thanks...
still no gpu support on ... guess i am missing some VAAPI hack 🤷

  • Alle
  • Abonniert
  • Moderiert
  • Favoriten
  • random
  • haupteingang
  • Alle Magazine