Co-occurrence Patterns of LoRA Adapters in Production Diffusion Model Inference Services
Low-rank adaptation (LoRA) has become a key technology for serving large-scale personalized large language models and diffusion models in the cloud. However, the co-occurrence patterns, resource contention relationships, and evolutionary regularities of adapters under production inference workloads have not been systematically or quantitatively studied. Based on GenTD26, Alibaba's production…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.