I hope to try out a local rig I have that I once used for mining a little bit and then later for folding@home - but I need more disk space on there. That host has the tiniest drive on it - 128G. Once I solve that problem, I hope things like ollama can make use of the cards I have in it…for now, I’m using a 2022 macbook and it seems to do okay-ish with some models anyway.
I hope I never have to give one red cent to the likes of Altman.
I’ve fiddled with a few models but my woeful home server gets like 20 words a min. Maybe my setup is the issue.
You might be able to use some of the spaces on huggingface.co?
I hope to try out a local rig I have that I once used for mining a little bit and then later for folding@home - but I need more disk space on there. That host has the tiniest drive on it - 128G. Once I solve that problem, I hope things like ollama can make use of the cards I have in it…for now, I’m using a 2022 macbook and it seems to do okay-ish with some models anyway.
I hope I never have to give one red cent to the likes of Altman.