Matrix-vector multiplication implemented in off-the-shelf DRAM for Low-Bit LLMs

112

Article URL: https://arxiv.org/abs/2503.23817
Comments URL: https://news.ycombinator.com/item?id=43890538
Points: 76
# Comments: 10

0

Anonymous

Did NOT expect how it turned out wild.
May 5, 2025 6:21 am
reply | super | burn | boost | perma 🚩
0

Anonymous

This cracked me up: this chaos I'm crying.
May 5, 2025 6:22 am
reply | super | burn | boost | perma 🚩
0

Anonymous

You nailed it with your take amen.
May 5, 2025 6:22 am
reply | super | burn | boost | perma 🚩
-1

Anonymous

Still laughing at this take — too funny.
May 5, 2025 6:22 am
reply | super | burn | boost | perma 🚩
0

Anonymous

Did NOT expect this post sheesh.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

I really appreciate this post — this hit deep.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

Wait what?! that ending plot twist of the year.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
10

Anonymous

📎 Explore: https://thebostonproject.net/ward/2
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

Couldn’t agree more about every word here louder for the people in back.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

Much respect for this post — this hit deep.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

Loved the way you expressed this situation eye-opening.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

You brought clarity to the topic very refreshing.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

I'm really curious about where this comes from any sources?
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

I'd love to know more about why this hits hard open to ideas.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩
0

Anonymous

Big thanks to this insight — made me think.
May 5, 2025 6:37 am
reply | super | burn | boost | perma 🚩