Skip to content

About

Notebooks to demonstrate ART (Agent Reinforcement Trainer) in practice!

Resources

Stars

11 stars

Watchers

0 watching

Forks

Repository files navigation

Notebooks to demonstrate ART (Agent Reinforcement Trainer) in practice!

The serverless notebooks use ART 0.5.24 and Qwen/Qwen3.8-27B through W&B Training. They require a W&B API key and do not require a local GPU. Local-GPU notebooks retain their own model and dependency settings.

Weave 0.53.9 and earlier fail during weave.init() with OpenTelemetry HTTP exporter 1.45 and later: AttributeError: 'OTLPSpanExporter' object has no attribute '_session'. ART 0.5.24 requires Weave 0.54.0 or later, so the serverless installation cells upgrade an older Weave. The local-GPU notebooks use older ART releases and pin Weave 0.54.0 directly. If you already imported ART or Weave, rerun the installation cell, restart the runtime, and continue from the environment-variable cell. The serverless installation cells pass the active kernel's Python executable to uv pip install.

📒 Notebooks

Agent Task Example Notebook Description Comparative Performance
ART•E [Serverless] 🏋️ Train agent Qwen 3.8 27B learns to search emails using RULER benchmarks
2048 🏋️ Train agent Qwen 3.8 27B learns to play 2048 benchmarks
ART•E LangGraph 🏋️ Train agent Qwen 2.5 7B learns to search emails using LangGraph [Link coming soon]
MCP•RL 🏋️ Train agent Qwen 2.5 3B masters the NWS MCP server [Link coming soon]
Temporal Clue 🏋️ Train agent Qwen 2.5 7B learns to solve Temporal Clue [Link coming soon]
Tic Tac Toe 🏋️ Train agent Qwen 2.5 3B learns to play Tic Tac Toe benchmarks
Codenames 🏋️ Train agent Qwen 2.5 3B learns to play Codenames benchmarks
AutoRL [RULER] 🏋️ Train agent Train Qwen 2.5 7B to master any task [Link coming soon]
Distillation (SFT) 🏋️ Train model Distill text-to-SQL from Qwen 3 235B to Qwen 3.8 27B [Link coming soon]
Summarizer (SFT + RL) 🏋️ Train model Train a document summarizer with SFT warmup then RL [Link coming soon]
SFT from a dataset 🏋️ Train model Fine-tune Qwen 3.8 27B on text-to-SQL from a dataset [Link coming soon]

Benchmark charts show results from their original runs, not measurements of the current notebook defaults.

🧩 Supported Models

ART should work with most vLLM/HuggingFace-transformers compatible causal language models, or at least the ones supported by Unsloth. Gemma 3 does not appear to be supported for the time being. If any other model isn't working for you, please let us know on Discord or open an issue on GitHub!

🤝 Contributing

ART is in active development, and contributions are most welcome! Please see the CONTRIBUTING.md file for more information.

⚖️ License

This repository's source code is available under the Apache-2.0 License.

🙏 Credits

ART stands on the shoulders of giants. While we owe many of the ideas and early experiments that led to ART's development to the open source RL community at large, we're especially grateful to the authors of the following projects:

Finally, thank you to our partners who've helped us test ART in the wild! We're excited to see what you all build with it.

About

Notebooks to demonstrate ART (Agent Reinforcement Trainer) in practice!

Resources

Stars

11 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages