AVO: Agentic Variation Operators for Autonomous Evolutionary Search
Paper • 2603.24517 • Published • 3
AI & ML interests
None defined yet.
Recent Activity
View all activity
akhaliq
submitted a
paper to Daily Papers about 8 hours ago
sergiopaniego
updated a
dataset about 20 hours ago
hysts
updated a
Space about 22 hours ago
hysts
updated 7
Spaces 1 day ago
Gemma 3 12b It
🔥
163
Chat with AI using text, images, or a video for instant answers
Gemma 2 2B JPN IT
😻
22
Chatbot
Gemma 2 9B IT
😻
101
Chatbot
Gemma 2 2B IT
😻
86
Chatbot
Llama 3.2 3B Instruct
😻
123
Chatbot
Llama 2 13b Chat
🦙
490
Chat with Llama‑2 13B for instant AI-generated replies
Llama 2 7B Chat
🏆
482
Chat with Llama‑2 7B model
pcuenq
updated a
dataset 6 days ago
akhaliq
submitted a
paper to Daily Papers 9 days ago
akhaliq
submitted a
paper to Daily Papers 12 days ago
sergiopaniego
posted an update 14 days ago
Post
568
ICYMI, great blog by @kashif and @stas on Ulysses Sequence Parallelism: train with million-token contexts
on 4×H100s: 12x longer sequences, 3.7x throughput
learn how to integrate it with Accelerate, Transformers, and TRL ⤵️
https://huggingface.co/blog/ulysses-sp
on 4×H100s: 12x longer sequences, 3.7x throughput
learn how to integrate it with Accelerate, Transformers, and TRL ⤵️
https://huggingface.co/blog/ulysses-sp
clefourrier
authored a
paper 15 days ago
AdinaY
submitted a
paper to Daily Papers 15 days ago
sergiopaniego
posted an update 16 days ago
Post
325
We just released a big blog surveying 16 OSS frameworks for async RL training of LLMs!
We're building a new async GRPO trainer for TRL and as first step, we needed to understand how the ecosystem solves this problem today.
The problem: in synchronous RL training, generation dominates wall-clock time. 32K-token rollouts on a 32B model take hours while training GPUs sit completely idle. With reasoning models and agentic RL making rollouts longer and more variable, this only gets worse.
The ecosystem converged on the same fix: separate inference + training onto different GPU pools, rollout buffer, and async weight sync.
We compared 16 frameworks across 7 axes: orchestration, buffer design, weight sync, staleness management, partial rollouts, LoRA, and MoE support.
This survey is step one. The async GRPO trainer for TRL is next!
https://huggingface.co/blog/async-rl-training-landscape
We're building a new async GRPO trainer for TRL and as first step, we needed to understand how the ecosystem solves this problem today.
The problem: in synchronous RL training, generation dominates wall-clock time. 32K-token rollouts on a 32B model take hours while training GPUs sit completely idle. With reasoning models and agentic RL making rollouts longer and more variable, this only gets worse.
The ecosystem converged on the same fix: separate inference + training onto different GPU pools, rollout buffer, and async weight sync.
We compared 16 frameworks across 7 axes: orchestration, buffer design, weight sync, staleness management, partial rollouts, LoRA, and MoE support.
This survey is step one. The async GRPO trainer for TRL is next!
https://huggingface.co/blog/async-rl-training-landscape
sergiopaniego
posted an update 16 days ago
Post
324
Nemotron 3 Super by @nvidia is here! NVIDIA's hybrid Mamba2/Transformer models are now natively supported in transformers (no trust_remote_code needed)
Fine-tune them with TRL in just a few lines of code. Notebook + script included to get started right away. goooo!
- Notebook: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_nemotron_3.ipynb
- Script: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_nemotron_3.py
- Collection with all the models: https://huggingface.co/collections/nvidia/nvidia-nemotron-v3
Fine-tune them with TRL in just a few lines of code. Notebook + script included to get started right away. goooo!
- Notebook: https://colab.research.google.com/github/huggingface/trl/blob/main/examples/notebooks/sft_nemotron_3.ipynb
- Script: https://github.com/huggingface/trl/blob/main/examples/scripts/sft_nemotron_3.py
- Collection with all the models: https://huggingface.co/collections/nvidia/nvidia-nemotron-v3
AdinaY
submitted a
paper to Daily Papers 19 days ago