This guide covers the first-person gaming RL subsystem in _AugmentedIntelligence.<\/p>\n\n\n\n
It is separate from the Minecraft Spigot plugin, but it uses the same idea:<\/p>\n\n\n\n
observe game state, choose actions, record transitions, train offline or online,<\/p>\n\n\n\n
and only actuate when the run mode allows it.<\/p>\n\n\n\n
For the shorter command overview, see docs\/GamingRL.md. For SourceMod,<\/p>\n\n\n\n
Quake, Garry’s Mod, and Civilization bridge setup, see<\/p>\n\n\n\n
docs\/GameModBridges.md.<\/p>\n\n\n\n
Use this only on your own local\/private games and servers. Do not use it to evade<\/p>\n\n\n\n
anti-cheat systems or automate play on public multiplayer servers.<\/p>\n\n\n\n
The FPS subsystem now has:<\/p>\n\n\n\n
cover, objective pressure, audio cues, death\/menu terminal states, and movement<\/p>\n\n\n\n
context.<\/p>\n\n\n\n
crouch, jump, reload, interact, melee, heal\/armor, peeking, retreat reload, and<\/p>\n\n\n\n
objective push.<\/p>\n\n\n\n
peek_strafe, movement, weapon_resource, and objective_use.<\/p>\n\n\n\n
feedback, checkpoint tags, rollback, policy explanation, evaluation, dashboard<\/p>\n\n\n\n
export, heatmap export, replay summaries, and bridge protocol export.<\/p>\n\n\n\n
audio direction, hit markers, damage, death screen, menus, and objective state.<\/p>\n\n\n\n
gaming mod bridge ….<\/p>\n\n\n\n
Start in dry-run mode before allowing key and mouse output:<\/p>\n\n\n\n
[text] When the actions and observations look reasonable:<\/p>\n\n\n\n [text] If behavior gets worse:<\/p>\n\n\n\n [text] [text] The transition log writes state features as s0 through s31.<\/p>\n\n\n\n [text] Adapters should normalize values to 0.0..1.0 where possible. Directional<\/p>\n\n\n\n values such as target dx, target dy, and audio threat yaw can use<\/p>\n\n\n\n -1.0..1.0.<\/p>\n\n\n\n [text] Use gaming rl skill use <action_id> to force one action once. This is useful<\/p>\n\n\n\n for verifying that the focused window is receiving input correctly.<\/p>\n\n\n\n The subsystem writes runtime data under:<\/p>\n\n\n\n [text] Important files:<\/p>\n\n\n\n [text] The Python trainer in gaming_rl\/train_fps_rl.py now detects the state columns<\/p>\n\n\n\n from transitions.csv, so it can train on both old 16-feature logs and new<\/p>\n\n\n\n 32-feature logs.<\/p>\n\n\n\n The core RL code does not perform game-specific OCR or minimap parsing directly.<\/p>\n\n\n\n It expects an adapter to populate FPSPerception. A complete adapter should<\/p>\n\n\n\n provide:<\/p>\n\n\n\n [text] gaming rl perception <request> records adapter requests to<\/p>\n\n\n\n fps_perception_requests.jsonl. gaming rl bridge spec exports the JSON bridge<\/p>\n\n\n\n schema to fps_bridge_protocol.json.<\/p>\n\n\n\n The GameModBridge receiver handles server-side Source\/Quake JSON telemetry and<\/p>\n\n\n\n feeds simple health, damage, and death signals into FPSPerception. It does not<\/p>\n\n\n\n replace richer client perception for aim targets, HUD OCR, audio threat, or<\/p>\n\n\n\n minimap reasoning.<\/p>\n\n\n\n Recommended staged curriculum:<\/p>\n\n\n\n [text] Use feedback to bias the policy after a behavior happens:<\/p>\n\n\n\n [text] This records a feedback event and feeds a shaped transition through the same<\/p>\n\n\n\n learning path.<\/p>\n\n\n\n Collect transitions during dry-run, assist, bot, train, or eval modes. Then run:<\/p>\n\n\n\n [text] For Python-side PPO or linear export:<\/p>\n\n\n\n [text] The Python script reads C:\/gaming_rl_logs\/transitions.csv by default.<\/p>\n\n\n\n [text] Do not move to the next phase until the current phase is boringly reliable.<\/p>\n","protected":false},"excerpt":{"rendered":" This guide covers the first-person gaming RL subsystem in _AugmentedIntelligence. It is separate from the Minecraft Spigot plugin, but it uses the same idea: observe game state, choose actions, record transitions, train offline or online, and only actuate when the run mode allows it. For the shorter command overview, see docs\/GamingRL.md. For SourceMod, Quake, Garry’s […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-1992","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/1992","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/comments?post=1992"}],"version-history":[{"count":1,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/1992\/revisions"}],"predecessor-version":[{"id":1993,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/1992\/revisions\/1993"}],"wp:attachment":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/media?parent=1992"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/categories?post=1992"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/tags?post=1992"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
<\/em>gaming rl init
gaming rl adapter set generic_fps
gaming rl input hold 120
gaming rl input mouse 32
gaming rl dry-run on
gaming rl curriculum start input_smoke
gaming rl status
gaming rl skills
gaming rl explain<\/p>\n\n\n\n
<\/em>gaming rl dry-run off
gaming rl mode bot
gaming rl train on
gaming rl eval 3
gaming rl dashboard
gaming rl heatmap
gaming rl checkpoint tag baseline<\/p>\n\n\n\n
<\/em>gaming rl checkpoint list
gaming rl checkpoint rollback baseline<\/p>\n\n\n\nImportant Commands<\/h2>\n\n\n\n
<\/em>gaming rl status
gaming rl features
gaming rl systems
gaming rl skills
gaming rl skill use <action_id>
gaming rl explain
gaming rl why
gaming rl mode off|assist|bot|train|eval
gaming rl train on|off|episode start|episode end
gaming rl eval [episodes]
gaming rl selfplay on|off
gaming rl adapter set <name>
gaming rl adapter status
gaming rl perception <request>
gaming rl input hold <milliseconds>
gaming rl input mouse <max_pixels_per_tick>
gaming rl dry-run on|off
gaming rl curriculum status
gaming rl curriculum start [phase]
gaming rl curriculum next
gaming rl curriculum phase <name>
gaming rl replay summary [path]
gaming rl replay tail
gaming rl replay train [path]
gaming rl bc train [epochs]
gaming rl bc status
gaming rl reward good [note]
gaming rl reward bad [note]
gaming rl reward <number> [note]
gaming rl dashboard
gaming rl heatmap
gaming rl bridge spec
gaming mod bridge status
gaming mod bridge configure source_mod 0.0.0.0 8767 YOUR_TOKEN true
gaming mod bridge configure quake_mod 0.0.0.0 8768 YOUR_TOKEN true
gaming mod bridge configure garrys_mod 0.0.0.0 8771 YOUR_TOKEN true
gaming mod bridge configure civilization_mod 0.0.0.0 8772 YOUR_TOKEN true
gaming rl checkpoint tag <tag>
gaming rl checkpoint list
gaming rl checkpoint rollback <tag><\/p>\n\n\n\nState Vector<\/h2>\n\n\n\n
<\/em>s0 target visible
s1 target dx
s2 target dy
s3 target size
s4 target velocity x
s5 target velocity y
s6 target confidence
s7 target centered\/alignment
s8 aim error magnitude
s9 recent action bias
s10 recent reward signal
s11 fire readiness
s12 movement context x
s13 movement context y
s14 training mode flag
s15 bias feature
s16 health normalized
s17 armor normalized
s18 ammo normalized
s19 reserve ammo normalized
s20 objective distance normalized
s21 damage taken recently
s22 hit marker
s23 death screen
s24 menu open
s25 reloading
s26 scoped
s27 on ground
s28 cover score
s29 minimap threat
s30 audio threat yaw
s31 audio threat strength<\/p>\n\n\n\nAction Library<\/h2>\n\n\n\n
<\/em>0 noop
1 aim_left
2 aim_right
3 aim_up
4 aim_down
5 fire
6 strafe_left
7 peek_left_forward
8 peek_right_forward
9 move_forward
10 move_back
11 strafe_right
12 jump
13 crouch
14 sprint_forward
15 reload
16 use_interact
17 swap_weapon
18 melee
19 heal_or_armor
20 peek_left_crouch
21 peek_right_crouch
22 retreat_reload
23 objective_push<\/p>\n\n\n\nFiles Written<\/h2>\n\n\n\n
<\/em>C:\/gaming_rl_logs\/<\/p>\n\n\n\n
<\/em>transitions.csv
fps_dashboard.json
fps_heatmap.csv
fps_bridge_protocol.json
fps_perception_requests.jsonl
fps_episode_events.jsonl
checkpoint.txt
checkpoint_<tag>.txt<\/p>\n\n\n\nAdapter Boundary<\/h2>\n\n\n\n
<\/em>target bbox\/center\/confidence
health, armor, ammo, reserve ammo
hit marker and recent damage
death screen and menu state
reload\/scoped\/on-ground state
cover score
objective distance
visible enemy count
minimap threat
audio threat yaw and strength<\/p>\n\n\n\nTraining Curriculum<\/h2>\n\n\n\n
<\/em>input_smoke
Dry-run first. Then force every action with `gaming rl skill use <id>`.
Verify mouse limits, key holds, sprint holding W, reload, crouch, jump, and
no accidental input into the wrong window.
aim_static
Use a stationary local target or aim trainer. Reward should come mostly from
target centering and hit markers. Keep movement disabled or ignored.
aim_tracking
Add moving targets. Watch `gaming rl explain` and `fps_heatmap.csv` to confirm
it is correcting yaw\/pitch rather than firing randomly.
movement_basic
Train forward, back, strafe, jump, crouch, and sprint in an empty area. Use
`gaming rl input hold 120` or higher if movement feels choppy.
cover_peek
Add cover. Reward cover score and penalize recent damage. Check that peek
actions appear in the action summary.
resource_loop
Add limited ammo and reload timing. Penalize firing while empty\/reloading and
reward clean reloads from cover.
combat_close
Add close-range combat. Enable melee and retreat_reload. Penalize death and
menu-open terminal states heavily.
objective_route
Add objective distance. Reward objective progress while preserving health and
avoiding visible threats.
mixed_eval
Run `gaming rl eval 10`, export dashboard and heatmap, then tag a checkpoint
only if returns and death rate improve.<\/p>\n\n\n\nHuman Feedback<\/h2>\n\n\n\n
<\/em>gaming rl reward good held angle correctly
gaming rl reward bad fired while reloading
gaming rl reward -0.5 walked into wall
gaming rl reward 1.0 took cover before reload<\/p>\n\n\n\nOffline Training<\/h2>\n\n\n\n
<\/em>gaming rl replay summary
gaming rl replay train
gaming rl bc train 5<\/p>\n\n\n\n
<\/em>python gaming_rl\/train_fps_rl.py –algo linear
python gaming_rl\/train_fps_rl.py –algo ppo<\/p>\n\n\n\nPractical Operating Loop<\/h2>\n\n\n\n
<\/em>gaming rl dry-run on
gaming rl curriculum start input_smoke
gaming rl skill use 9
gaming rl skill use 14
gaming rl skill use 5
gaming rl explain
gaming rl dashboard
gaming rl dry-run off
gaming rl curriculum phase aim_static
gaming rl mode train
gaming rl train on
gaming rl eval 5
gaming rl dashboard
gaming rl heatmap
gaming rl checkpoint tag aim_static_good
gaming rl curriculum next<\/p>\n\n\n\n