The DGX Spark I ordered has arrived
It's heavier than I thought and the adapter is quite large
I got the cheapest one from Computer Zone with MSI and 1TB storage
A slave to installment payments
I didn't know how to set it up, but when I asked AI, it explained it well
Anyway, the fine-tuning speed is 33% faster than the existing AMD AI Max 395. That's CUDA for you
And since it's possible to fine-tune with Q4 as well, I should try fine-tuning a larger model
The existing AMD 395 didn't have an official ROCm driver, so I fine-tuned it with Derack using FP16, but CUDA really just works. It just takes a long time...
I did some stock reorganizing
ㅠㅠ
