I really enjoyed this video!

I have my local LLM rig (powered by solar) for asking stupid questions because I feel it’s unreasonable to ask a data centre somewhere why spoons taste funny

I’ve been trying the 32b instruct variant at Q4_K_M and it’s been solid for general use, tool use, and image comprehension. Pretty impressive