I tried the BC250 40 CU unlock instructions right away on the day I saw them, but
the patch kept failing to build on fedora, so I had a miserable Friday morning after sleeping for three hours and going to work.
Over the weekend, I pushed fedora aside and uploaded it to cachyos. After several attempts, I successfully uploaded it.
Qwen 3.6 27b, 35BA3B, Gemma4 26BA4B were all done with IQ3.
24CU
40CU
I wonder if the difference would be even greater for smaller models, but I've only tried the famous ones.
Cachyos seems to have tuned something in a way that causes it to crash immediately when memory overflows. So, usability is not great when running local llm.
