github.com

Show HN: Lumabri – Run Moe Models on a P2P Swarm with Colibri

vforno · 18 points · 3 comments · 9 ชั่วโมงที่ผ่านมา · Open original

Comments

2 preview comments · loading full thread
ptsneves13 นาทีที่ผ่านมา

P2P inference sounds really nice and it would bring us back to the 2000s culture if not for the fact inference is already so cheap. Even so it is an insurance policy if the cloud providers or governments have ideas of further censoring and monitoring chats.

RIshabh2351 ชั่วโมงที่ผ่านมา

great work