BoF: Share experiences running and using Local/Self-hosted/"Open-source" LLMs

Facilitator: ekes, Iskra (Freelance)

So who has tried running local LLMs? Let's take this chance to share anything that worked, what didn't, and what's the best setup and uses. If no one turns up with any experiences to share I guess I should have lemonade running s.l.o.w.l.y with something on my laptop... maybe you too?