Sorry, I didn’t want to come across as detached. It’s true that my hardware budget increased in the last ~ 15 years but even then I would have considered 700 € (that’s what I paid for my card) a very tight budget for a moderate gaming pc in my country.
Sockenklaus
- 0 Posts
- 4 Comments
Joined 3 years ago
Cake day: June 24th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
When I bought that card this year I payed significantly less than you’re suggesting. That’s still a lot of money but it’s not more than many gamers where willing to pay for their gpus way, way before ramageddon. Of course you can’t run open weights on a potato but you also don’t need a $4000 gpu to do so.
As for the rest of your comment? What? 🤷
You may be overestimating the hardware requirements for current open weights. I am running Qwen3.8-27b with 52.000 tokens context on a RX 7900 XTX from 2022 with 15 - 30 tokens / second. Sure, it was a high end card back then but for a graphics card today it’s quite affordable when you’re looking for a used one. Also it’s not blazingly fast, but it gets the job done.
I payed around 700 € used, but in turn I sold my previous GPU for ~ 400 € and I got a significant performance upgrade for that money.