coffee_with_cream@sh.itjust.workstoSelfhosted@lemmy.world•Self-Hosted AI is pretty darn coolEnglish
25·
1 month agoYou probably want 48gb of vram or more to run the good stuff. I recommend renting GPU time instead of using your own hardware, via AWS or other vendors - runpod.io is pretty good.
Not everyone has a coke budget 😞