Avatar

·

gfx1103 + MoE failure

I’m sorry to say that trying to configure my AMD Ryzen 7 8700G GPU has given way to failures in the gfx1103 library. The fall back is to just use the CPU. I change the Ollama LLM from mixtral:8x7b-instruct-v0.1-q5_K_M to llama3.2:latest.

The fix is to purchase an RTX 3090 or RTX 4090 and connect it to the DEG1 I purchased. I think I’ll suffer through the lack of accelerated processing and wait and see what surprises the fall brings. Maybe some NVIDIA GTX Sparc computer from Minisforum.

The Miniseries MS-A1 is a great computer. The cost of the docking station was about $110. The $1,500 – $4,000 for the graphics card is high enough to pause where I am and to wait for the next wave of hardware to come out.

I’m sure the new systems out this fall will be in the $5,000 range, but will probably be a next step in AI computing with more memory and faster AI processing.

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Discover more from sumo.computer

Subscribe now to keep reading and get access to the full archive.

Continue reading