Measurement-Driven Sub-Network Selection for On-Premise Retrieval-Augmented Factory Agents
On-premise assistants can give factory workers conversational access to machine documentation, but models capable of the task rarely fit shop-floor hardware. We show that after structural compression and retrieval-grounded adaptation, model size is no longer a reliable predictor of adapted answer quality: general capability falls almost linearly with parameter count, while judged…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.