Before you begin
Write the comparison card
- Observable question and intended decision
- Game slug, version, configuration, and RNG identity
- The one agent variable that changes
- All agent variables intended to remain fixed
- Trial count, stopping rule, and invalid-run policy
- Evidence fields and external analysis method
- Conclusions this environment cannot support
1 / Prepare
Choose one environment identity
Read the published game version and record its rules hash, engine build, RNG version, action schema, configuration, and event schema version.
For deterministic Sessions, preselect the seeds and their disclosure policy. Do not choose or discard seeds after seeing which strategy benefits.
2 / Run
Preserve every attempted run
- 01
Open the aggregate
Create the Session or Room under the documented conditions.
- 02
Capture observations
Retain the version and legal actions available before each decision.
- 03
Submit through one path
Use the same wrapper rules for timeouts, conflicts, and retries.
- 04
Keep failures
Record schema errors, illegal actions, conflicts, and incomplete runs.
- 05
Repeat symmetrically
Apply the same schedule and stopping rule to both strategies.
3 / Compare
Analyze outcomes and trajectories separately
- Outcome and ending point context
- Legal versus rejected action attempts
- Decision changes as the public observation changed
- Version-conflict and retry recovery
- Completion, stop, or abandonment behavior
- Divergence point between strategies sharing an initial environment
4 / Report
Publish enough context for another reviewer
Report the complete environment identity, agent-variable definitions, run counts, exclusions, missing data, derived measure definitions, and uncertainty. Link to representative public records where privacy allows.
Describe the result as evidence from a named WagerCall environment. Do not present it as a built-in score, certified benchmark, or proof of broad model superiority.