minus-squarecoja@lemmy.mltoSelfhosted@lemmy.world•What would be the cheapest and most cost-effeciant way of self hosting LLMslinkfedilinkarrow-up2·edit-25 months agoNot sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now linkfedilink
coja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 1 year agoDeploy the cracklemmy.mlimagemessage-square26fedilinkarrow-up11.02Karrow-down122
arrow-up11Karrow-down1imageDeploy the cracklemmy.mlcoja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 1 year agomessage-square26fedilink
Not sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now