Async GRPO with LoRA across HF Jobs uses a bucket, a proxy, and no NCCL, leveraging Hugging Face Jobs and Storage Buckets to train a LoRA adapter and sync only that adapter to vLLM replicas. The proxy routes each rollout to the replica that already holds its KV prefix and broadcasts adapter loads to all replicas. AI summary
Firehose
Filtered to Companies, tagged “low-rank approximation” · clear filters
Browse: People · Companies · Papers · Podcasts · Hacker News · Deep dives