Chemical Wonka@discuss.tchncs.de to Privacy@lemmy.worldEnglish · 2 days agoPlease, don't!discuss.tchncs.deimagemessage-square72fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imagePlease, don't!discuss.tchncs.deChemical Wonka@discuss.tchncs.de to Privacy@lemmy.worldEnglish · 2 days agomessage-square72fedilink
minus-squareKoalaUnknown@lemmy.worldlinkfedilinkEnglisharrow-up0·edit-22 days agoI run models at 10-20B parameters pretty easily on my M1 Pro MacBook. You can get good response times for decent models on a $500 M4 Mac Mini. A $4000 Nvidia GPU isn’t necessary.
I run models at 10-20B parameters pretty easily on my M1 Pro MacBook. You can get good response times for decent models on a $500 M4 Mac Mini. A $4000 Nvidia GPU isn’t necessary.