LLM
Posts tagged “LLM”.
- 72 GB of VRAM, No Graphics Card
A mini-PC assigned 72 GB of system RAM to its iGPU and ran a 120B model, but memory bandwidth limited generation to reading speed.
- What Changed When Models Could Answer Each Other
I compared parallel model responses with a sequential, stateful debate in which each model could rebut or concede points made in earlier turns.