Man2Dev

Man2Dev , vor 2 Tagen

@karolherbst Awesome, hopefully with this I can finally make a binary with OpenCL and have it run :blobcataww:

Man2Dev , vor 14 Tagen

@karolherbst the shprt answer is no atleat in fedora. We're practically done with the rocm acceleration thanks to Tom and the rest of the AI sig but vulkan support is lackluster at best to my knowledge I'm the only one trying to add it the ai/ml packages in fedora. I think i it was mentioned that some one was working on opencl Support but I have no idea how far that's going

Man2Dev , vor 14 Tagen

@karolherbst oh i use whisper.cpp

Man2Dev , vor 14 Tagen

@karolherbst a large portion of Private Ai Packages rely heavily on llama.cpp and whisper.cpp at the moment for example ollama it's basically just a pretty client for llama.cpp with some quality of life improvements.

Man2Dev , vor 14 Tagen

@karolherbst there's no argument there the project as a whole needs improvements on a lot of things. But as for needing beefy's gpus I wouldn't say it's needed for all cases you can and I have run smaller models on CPU alone with just AVX acceleration on llama.cpp. but as for whisper.cpp the last time I tried it with cpu alone it wasn't at all usable

Man2Dev , vor 14 Tagen

@karolherbst I mean that would be the best case scenario if they had optimizations for more platforms but that's not feasible for a lot of Open Source projects so they just rely on random libraries or features that are already built into certain platforms to do most of the heavy lifting for them

Man2Dev , vor einem Monat

@karolherbst i thought the same thing untill i looked into it and it kind of makes sense

Man2Dev , vor einem Monat

@karolherbst git woeks with gpg which is basicly a uniqe signiture (for each individual) now how do you tie down who each person is?

Man2Dev , vor einem Monat

@karolherbst actually email and gpg are very relevet in my opinion. think about it when you want to sign up for any service what do you use for your credentials most if not all require emails. So by tying your signature to something that is so widely used and so integral to your identity it creates more trust.
1/2

Man2Dev , vor einem Monat

@karolherbst And yes gpg doesn't necessarily need to work with email however there are not many great distributed Communications protocols out there that fulfill all the use cases that email are used for. The closes thing i have seen so far is Matrix with the use of bridges for emails. But Matrix has its own problems such as not not having a very good implementation of the server or the client (though it's getting better)
2/3

Man2Dev , vor einem Monat

@karolherbst and as far i remmber Matrix has even taken this further by tying the identity to the signature and not to the server as such the identity can switch servers without being needed to be tied down to a certain domain or address
3/3

Man2Dev , vor einem Monat

@karolherbst I absolutely agree that the main reason this got started was because email was the primary means of communication in the Linux kernel and that pepeole can use how many identity as they want to commit. Im just pointing out that this has become in integral part of distributed identity verification all across diffrent git repos and difrent git forges. And for any comunication service to replace email as means of Communications they would need to be (in my opinion):

Man2Dev , vor einem Monat

@karolherbst

1. Need to be truly distributed:
   (anyone or any organization should easily be able to set up their own instance and be able to communicate with the entire network)
2. Have good spam protection:
   ( which has historically been a problem for email and the main reason that email providers are now breaking compatibility with the rest of the network)
3. Easily Deployable
4. Support distributed ID (DID):
   (Such as gpg keys. Or any DID which could also provide the means of communication)
   2/3

Man2Dev , vor einem Monat

@karolherbst hence why we are stuck in this predicament although we have communication protocols not all of them provide all the functionality needed to support this workflow. But it's not all bad news like I said Matrix as a protocol does pretty much do what everybody needs and even supports Legacy workflows (like email) through Bridges but the reality of it is that the implementations of Matrix currently are not up to snuff for production use
3/3

Man2Dev , vor einem Monat

@karolherbst I don't know perhaps I am overestimating the email bit for the development workflow after all my research on the topic isn't complete however I personally disagree on commit signing because it's a great means of confirmation identity of the code authers. And although I was mostly talked in favor of email so far I personally am not a fan hence why I've done all this research because I want to get rid of it

Man2Dev , vor einem Monat

@karolherbst yes spamming is a real problem when it comes to any distributed means of communication. the only temporary fix is too use email forwarding and email aliasing services to at least minimize massages you don't want to get in your inbox

Man2Dev , vor einem Monat

@karolherbst I agree with you but fast is just made up of different projects working together so such inconveniences can't be helped but as for removing emails that have been committed as far as i know you can remove and change that data which has bean commited if i recal correcly its though git bisect i think

Man2Dev , vor einem Monat

@karolherbst last time I checked the most recommendations would just say to use a Dynamic DNS

Man2Dev , vor einem Monat

@karolherbst i belive there was cloudflare service that would handle all of that for you (of course that assuming that you don't want to do all of that locally)

Man2Dev , vor einem Monat

@karolherbst have you looked into Proxmox. Last time around I tried to do this it helped a lot

Man2Dev , vor einem Monat

@karolherbst with Proxmox you can have better isolation between your different containers and virtual machines

Man2Dev , vor einem Monat

@karolherbst not necessarily. What I was trying to do last time around I was trying to set up a Virtual Router and Dynamic DNS inside proxmox which would then feed into my multiple boxes. And due to the fact that they were all in their isolated boxes I could restrict them very easily without need to actually change the software or configs

Man2Dev , vor einem Monat

@karolherbst i havent tested this but you could use port forwarding for that or just have it pass though a self hosted dynamic dns

Man2Dev , vor einem Monat

@karolherbst yeah youre right no matter how you set it up you have to deal with sitting up Dynamic DNS and firewall

Man2Dev , vor einem Monat

@karolherbst https://www.youtube.com/channel/UCHkYOD-3fZbuGhwsADBd9ZQ
Check out lawrence systems his stuff has helped me out a lot

Man2Dev , vor einem Monat

@karolherbst
Thus was the cloudflare service I was talking about https://www.youtube.com/watch?v=eojWaJQvqiw

Man2Dev , vor einem Monat

@karolherbst try to debug why llama-cpp package builds locall but fails in koji if i have time look into why volken loader isn't working properly on NVIDIA