Fix advantage calculation off-by-one error (#363)#445

Open

jacobarrio wants to merge 1 commit intoPufferAI:3.0from

jacobarrio:fix-advantage-off-by-one

Commits on Dec 29, 2025

fix advantage off-by-one: store horizon+1 states for horizon transitions
jacobarrio
committed