HomeBlogPricingCareersDocsGitHubSlack community
Field notes/Community builds/Snapshot Once, Rollout a Thousand Times: A Practical RL Setup for Coding Agents

Snapshot Once, Rollout a Thousand Times: A Practical RL Setup for Coding Agents

Snapshot the environment once and fork every rollout from it: 8,000 RL rollouts drop from ~20 hours of naive environment rebuilds to ~4.4 hours.

SBX-01C4SBX-01E3SBX-0202SBX-0221SBX-0240SBX-025FSBX-027ESBX-029DSBX-02BCSBX-02DBSBX-02FASBX-0319SBX-0338SBX-0357SBX-0376[ RUNTIME: ACTIVE ] P50 2.45S · P99 4.12S · 5M/PROJECT

The RL-training version of the snapshot argument: build the environment once, snapshot it, and fork every rollout from that image. Across 8,000 rollouts for a coding agent, Sebastian's setup drops environment time from roughly 20 hours of naive rebuilds to about 4.4 hours — the difference between an overnight run and a same-day iteration loop.

We didn’t write this one — it’s Sebastian Buzdugan’s piece, published on Data Science Collective. The note above is ours; the full article is theirs.

Read the full piece on Data Science Collective
SB
WRITTEN BYSebastian BuzduganCommunity · Data Science Collective
Read next —FROM THE LOG
◆ THE SANDBOX DIGEST

Subscribe for release notes, benchmarks, deep dives.

One dispatch per month from the Tensorlake team — no spam.