Jeff Geerling

32 GB GPU on a Pi CM5; You don't even have to recompile Linux anymore! Testing underway, but check out my latest blog post on www.jeffgeerling.com for a quick how-to.

2 days ago | [YT] | 2,517



@lephtovermeet

I actually look forward to the next generation of gaming PCs: $500GPUs with a $100 SBC attached running SteamOS.

2 days ago | 189  

@charlesmurtaugh3771

This setup makes me think of Portal 2, where you discover that this whole complex evil computer system is ultimately hooked up to a kid’s science project drawing electricity from a potato.

2 days ago | 165  

@4.0.4

This seems like the ideal home AI setup. Games probably run like crap but a multimodal LLM should be doable!

2 days ago | 19

@davidneal1127

I really wish Apple did a better job of supporting eGPUs because yeah an old mac mini running steamos with a recycled GPU would make a great ewaste sink.

2 days ago | 26  

@дадададададададададададада-и1ч

that small setup is more powerful than my pc!!!! its perfect toset up local ai on cars an maybe suits!!!!

4 hours ago | 0

@cacheman

> You don't even have to recompile Linux anymore! I'm out.

19 hours ago | 1

@fanlessfurmark

But can it run Crysis, Escape from Tarkov, MS flight sim, UEBS II, and chicken invaders, each on an individual VM? Asking for a roomful of friends.

2 days ago | 22  

@zyeborm

You know I'm pretty sure NVIDIA said something about putting riscv cores in their gpus already. You're probably not far from skipping the pi5.

1 day ago | 0

@Windfisch1981

Might be a game changer for local AI. Can be left running without drawing too much power on idle and only spin up when actually being used.

1 day ago | 1

@moccaloto

It's like strapping a 1000hp outboard motor to a rowboat

2 days ago | 7

@RobertSmith-lh6hg

Wendell please have a look at VLLM open issues, I got native FP8 working for R9700s it's a 60% performance uplift, exceeding the int8 performance. Someone was kind enough to post a docker image with my patch already rolled into it. And for gaming it'll be within about 2% of the 9070 XT...

1 day ago (edited) | 0

@ccpDial

我終於忍痛$350買左AVGO,下手後就下跌了😭😭😭

2 days ago | 0

@MikeDen-px2oc

So at this point can u train ai models and run them is it worth it

5 hours ago | 0

@zalaquin

Yes please release this asap

1 day ago | 0

@lady.foxpoint

i don't have a pi 5 let alone a gpu like that... but hey, neat! we've come a long way :D

1 day ago | 0

@MichaelOfRohan

Thats sick that it just works now, the devs have too much time on their hands ❤️🙏

1 day ago | 0

@ProjectileGrommet

Hoping the steam machine gets sick eGPU support

1 day ago | 0

@paulsalmon613

Why , just why?

4 hours ago | 0

@axelprino

What I find hilarious is than that power source is there just for the GPU 😂

1 day ago | 0

@johnsonlam

Not enough Thank you for you for all the testing and documentation, I know how much work since I tried but give up.

2 days ago | 1