williamtries , an Random Englisch
@williamtries@floss.social avatar

I just posted a short tutorial on setting up a simple on your running . The LLM (7b alpaca in this case) is not terribly accurate but possibly useful in some cases.

Warning! You phone will get hot. I haven't tested it long enough to know if it will harm your device, but do be careful.

Oh! I have a website now! Wow! My history with websites is hit and miss, so enjoy it while it lasts. I have half a dozen posts in the works already.

https://www.williamtries.ovh/llmonpmos/

pocketvj ,
@pocketvj@fosstodon.org avatar

@okias @williamtries

how do we find the correct gpu name to enable ?

RUSTICL_ENABLE=sdm845gpucc
or is it:
qcom or adreno ?

  • Alle
  • Abonniert
  • Moderiert
  • Favoriten
  • random
  • haupteingang
  • Alle Magazine