ESP32S3 cluster running 1.58-bit (BitNet) Language model
nkko · 150 points · 31 comments · 어제 · Open original
Comments
5 preview comments · loading full thread
Log in to use comments
Log in to h4cker, then connect Hacker News to publish comments.
LAladyanita22어제
This is something I've been fantasizing about for long.
Let's say we took Rust, a language that makes parallelization easier than others (as it helps you avoid some common footguns). How difficult would it be to have a massively parallel computer system made out of many tiny, simple microcontroller-like chips? Let's say we picked many little Risc-V's. Surely this would be an interesting experiment (though I'm not sure whether it'd make economic sense or not...)
TDtdhz77어제
Soon ai in every lightbulb running Kubernetes
CAcameron_b어제
It is a bit of a bummer to see that the degree of 'compression' makes it a fancy llm noise-maker. It is still charming.
LIlibrasteve어제
haha … this is precisely the kind of project that https://bil-lang.org is aimed at: Go for parallel (ie in this case pipeline processing).
don’t get too excited until we get the TinyGo backend built though ;-)
NDNDlurker어제
I'm curious how this would handle grammar checking on a basic word processor. Or maybe generate worlds for small text based games. I have no idea what the capabilities are of a cluster like this.
Comments
5 preview comments · loading full threadLog in to h4cker, then connect Hacker News to publish comments.
This is something I've been fantasizing about for long. Let's say we took Rust, a language that makes parallelization easier than others (as it helps you avoid some common footguns). How difficult would it be to have a massively parallel computer system made out of many tiny, simple microcontroller-like chips? Let's say we picked many little Risc-V's. Surely this would be an interesting experiment (though I'm not sure whether it'd make economic sense or not...)
Soon ai in every lightbulb running Kubernetes
It is a bit of a bummer to see that the degree of 'compression' makes it a fancy llm noise-maker. It is still charming.
haha … this is precisely the kind of project that https://bil-lang.org is aimed at: Go for parallel (ie in this case pipeline processing). don’t get too excited until we get the TinyGo backend built though ;-)
I'm curious how this would handle grammar checking on a basic word processor. Or maybe generate worlds for small text based games. I have no idea what the capabilities are of a cluster like this.