{"id":2065,"date":"2026-07-18T06:51:20","date_gmt":"2026-07-18T13:51:20","guid":{"rendered":"http:\/\/macdaddy4sure.ai\/?p=2065"},"modified":"2026-07-18T06:51:20","modified_gmt":"2026-07-18T13:51:20","slug":"rl-domains-and-systems","status":"publish","type":"post","link":"http:\/\/macdaddy4sure.ai\/index.php\/2026\/07\/18\/rl-domains-and-systems\/","title":{"rendered":"RL Domains And Systems"},"content":{"rendered":"\n<p>This document is the map of the reinforcement-learning surface in<\/p>\n\n\n\n<p>_AugmentedIntelligence. It explains the shared RL infrastructure, the domain<\/p>\n\n\n\n<p>modules, the training\/deployment ladder, and the commands used to inspect or run<\/p>\n\n\n\n<p>the systems.<\/p>\n\n\n\n<p>For MathNN details, see docs\/MathNN.md. For the live curriculum catalog, see<\/p>\n\n\n\n<p>docs\/RLCurriculum.md.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Big Picture<\/h2>\n\n\n\n<p>The RL stack has three layers:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Generic RL substrate: state\/action spaces, environments, replay buffers,<\/li>\n<\/ol>\n\n\n\n<p>&nbsp;&nbsp; algorithms, exploration, planning, neural DQN, distributed RL, and deployment<\/p>\n\n\n\n<p>&nbsp;&nbsp; gates.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Domain modules: Minecraft, FPS gaming, strategy games, driving, knowledge,<\/li>\n<\/ul>\n\n\n\n<p>&nbsp;&nbsp; parenting, political-news triage, real-world hooks, and curriculum smoke<\/p>\n\n\n\n<p>&nbsp;&nbsp; environments.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Safety\/deployment controls: simulation-first training, offline replay,<\/li>\n<\/ul>\n\n\n\n<p>&nbsp;&nbsp; shadow mode, gated live execution, safe-action shields, checkpoints, and<\/p>\n\n\n\n<p>&nbsp;&nbsp; promotion rules.<\/p>\n\n\n\n<p>The preferred path for any domain is:<\/p>\n\n\n\n<p><em>[text]<br><\/em>Sim -&gt; Offline -&gt; Shadow -&gt; GatedLive -&gt; Live<\/p>\n\n\n\n<p>Do not skip directly to live actuation. High-stakes domains should remain in<\/p>\n\n\n\n<p>simulation, offline analysis, or human-reviewed advisory mode unless there is a<\/p>\n\n\n\n<p>separate validated safety layer.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Shared RL Infrastructure<\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>System<\/strong><\/td><td><strong>Main files<\/strong><\/td><td><strong>Purpose<\/strong><\/td><\/tr><tr><td>RL core<\/td><td>RLCore.hpp\/.cpp<\/td><td>Defines RLEnv, spaces, transitions, replay buffers, prioritized replay, RNG, and checkpoint registry.<\/td><\/tr><tr><td>RL algorithms<\/td><td>RLAlgorithms.hpp\/.cpp<\/td><td>Implements tabular and lightweight value-based learners; declares remote deep-RL trainers.<\/td><\/tr><tr><td>RL trainer<\/td><td>RLFeatures.hpp\/.cpp<\/td><td>Provides the unified trainer loop and umbrella rl &#8230; command dispatcher.<\/td><\/tr><tr><td>Exploration and safety<\/td><td>RLExplore.hpp\/.cpp<\/td><td>Greedy, epsilon-greedy, Boltzmann, UCB, Thompson sampling, curiosity, reward shaping, and safe action shielding.<\/td><\/tr><tr><td>Neural DQN<\/td><td>RLNeural.hpp\/.cpp<\/td><td>In-process DQN using MathNN online\/target Q-networks and replay.<\/td><\/tr><tr><td>Agent neural registry<\/td><td>RLAgentNet.hpp\/.cpp<\/td><td>Opt-in MathNN DQN registry for named agents such as Minecraft, driving, FPS gaming, and strategy.<\/td><\/tr><tr><td>Planning<\/td><td>RLPlanning.hpp\/.cpp<\/td><td>Generic MCTS\/UCT planner plus world-model interface.<\/td><\/tr><tr><td>Distributed RL<\/td><td>RLDistributed.hpp\/.cpp<\/td><td>Actor\/learner transition push, parameter publishing, PBT, RLAIF scoring, and offline dataset loading.<\/td><\/tr><tr><td>Differential RL<\/td><td>RLDifferential.hpp\/.cpp<\/td><td>Physics\/ODE environments, CartPole, OU exploration, stability tripwire, and reachability safety checks.<\/td><\/tr><tr><td>Real-world RL<\/td><td>RLReal.hpp\/.cpp, RLRealEnvs.hpp\/.cpp<\/td><td>Real environment registry, LLM-routing bandit, and hook-driven environment presets.<\/td><\/tr><tr><td>Deployment<\/td><td>RLDeployment.hpp\/.cpp<\/td><td>Sim\/offline\/shadow\/gated\/live stage gate and action-execution choke point.<\/td><\/tr><tr><td>Curriculum<\/td><td>RLCurriculumOrchestrator.hpp\/.cpp<\/td><td>Catalog of RL domains and safe smoke environments.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Algorithms<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Local C++ Algorithms<\/h3>\n\n\n\n<p>These run locally without a tensor\/autograd backend:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Q-learning<\/li>\n\n\n\n<li>Double Q-learning<\/li>\n\n\n\n<li>SARSA(lambda)<\/li>\n\n\n\n<li>Expected SARSA<\/li>\n\n\n\n<li>Dyna-Q<\/li>\n\n\n\n<li>Linear-Q function approximation<\/li>\n\n\n\n<li>UCB bandits<\/li>\n\n\n\n<li>Thompson-sampling bandits<\/li>\n\n\n\n<li>Epsilon-greedy and Boltzmann exploration<\/li>\n\n\n\n<li>Count-based intrinsic curiosity<\/li>\n\n\n\n<li>MCTS\/UCT planning<\/li>\n\n\n\n<li>MathNN-backed in-process DQN<\/li>\n<\/ul>\n\n\n\n<p>Use these for smoke tests, tabular policies, smaller state vectors, action<\/p>\n\n\n\n<p>selection, and local DQN experiments.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Remote Or Heavy Deep-RL Algorithms<\/h3>\n\n\n\n<p>These are declared in the deep-RL interface and route to a remote policy server<\/p>\n\n\n\n<p>or tensor\/autograd backend for training:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>PPO<\/li>\n\n\n\n<li>A2C<\/li>\n\n\n\n<li>SAC<\/li>\n\n\n\n<li>TD3<\/li>\n\n\n\n<li>DDPG<\/li>\n\n\n\n<li>IQL<\/li>\n\n\n\n<li>CQL<\/li>\n\n\n\n<li>Rainbow DQN<\/li>\n\n\n\n<li>C51<\/li>\n\n\n\n<li>QR-DQN<\/li>\n\n\n\n<li>Dreamer<\/li>\n\n\n\n<li>GAIL<\/li>\n\n\n\n<li>Behavior Cloning<\/li>\n\n\n\n<li>ICM<\/li>\n\n\n\n<li>RND<\/li>\n\n\n\n<li>DIAYN<\/li>\n<\/ul>\n\n\n\n<p>Use these when the policy needs large neural networks, continuous-control<\/p>\n\n\n\n<p>training, offline deep RL, imitation learning, or heavy world-model training.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Core Commands<\/h2>\n\n\n\n<p>General RL:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl status<br>rl seed &lt;n&gt;<br>rl registry<br>rl registry best &lt;agent&gt;<br>rl deep train &lt;algo&gt; &lt;env&gt; &lt;state_dim&gt; &lt;action_dim&gt; [continuous]<br>rl push &lt;serialized-transition&gt;<\/p>\n\n\n\n<p>Neural per-agent policy registry:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl net status<br>rl net enable &lt;agent&gt;<br>rl net disable &lt;agent&gt;<br>rl net save &lt;agent&gt; &lt;path&gt;<br>rl net load &lt;agent&gt; &lt;path&gt;<\/p>\n\n\n\n<p>Real-world\/deployment:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl real status<br>rl real envs<br>rl real route<br>rl real stage &lt;agent&gt; &lt;sim|offline|shadow|gatedlive|live&gt;<br>rl real gate &lt;agent&gt; &lt;action&gt;<br>rl real promote &lt;agent&gt; &lt;version&gt;<\/p>\n\n\n\n<p>Curriculum:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl curriculum status<br>rl curriculum plan<br>rl curriculum next<br>rl curriculum domains [category]<br>rl curriculum domain &lt;id&gt;<br>rl curriculum envs<br>rl curriculum smoke all [episodes] [max_steps]<br>rl curriculum smoke &lt;domain_id&gt; [episodes] [max_steps]<br>rl curriculum export [path]<\/p>\n\n\n\n<p>Short aliases:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl domains [category]<br>rl domain &lt;id&gt;<br>rl sim game smoke [episodes] [max_steps]<br>rl sim physics smoke [episodes] [max_steps]<br>rl sim robot smoke [episodes] [max_steps]<br>rl sim energy smoke [episodes] [max_steps]<br>rl sim windows smoke [episodes] [max_steps]<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Domain Modules<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Minecraft DQN<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>MinecraftDQN.hpp\/.cpp<\/li>\n\n\n\n<li>MinecraftSpigotBridge.hpp\/.cpp<\/li>\n\n\n\n<li>MinecraftClientController.hpp\/.cpp<\/li>\n\n\n\n<li>minecraft_spigot_plugin\/<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Minecraft DQN observes player\/server state through the Spigot bridge, selects<\/p>\n\n\n\n<p>actions, computes rewards, logs transitions, and can execute actions through the<\/p>\n\n\n\n<p>server bridge, local client input, or both.<\/p>\n\n\n\n<p>State\/action shape:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>State size: 48 features.<\/li>\n\n\n\n<li>Action count: 26 discrete actions.<\/li>\n\n\n\n<li>Features include position, health, food, XP, time, yaw\/pitch, nearby entities,<\/li>\n<\/ul>\n\n\n\n<p>&nbsp; inventory\/tool flags, blocked directions, target block information, world,<\/p>\n\n\n\n<p>&nbsp; biome, game mode, selected item, and bridge observation ID.<\/p>\n\n\n\n<p>Main commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>minecraft dqn status<br>minecraft dqn player &lt;selector-or-name&gt;<br>minecraft dqn observe<br>minecraft dqn train [interval_ms]<br>minecraft dqn eval<br>minecraft dqn off<br>minecraft dqn step<br>minecraft dqn dry-run<br>minecraft dqn qvalues<br>minecraft dqn explain [top_n]<br>minecraft dqn control server|client|both<br>minecraft dqn wall-guard on|off|status<br>minecraft dqn unstuck on|off|status<br>minecraft dqn interval &lt;milliseconds&gt;<br>minecraft dqn epsilon &lt;0.0-1.0&gt;<br>minecraft dqn reward &lt;value&gt; [terminal]<br>minecraft dqn save [path]<br>minecraft dqn load [path]<br>minecraft dqn net on|off|status|save &lt;path&gt;|load &lt;path&gt;<\/p>\n\n\n\n<p>Client-control commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>minecraft dqn client status<br>minecraft dqn client focus on|off<br>minecraft dqn client foreground on|off<br>minecraft dqn client hold &lt;milliseconds&gt;<br>minecraft dqn client mine-hold &lt;milliseconds&gt;<br>minecraft dqn client use-hold &lt;milliseconds&gt;<br>minecraft dqn client mine<br>minecraft dqn client place<br>minecraft dqn client slot &lt;1-9&gt;<br>minecraft dqn client look-up<br>minecraft dqn client look-down<br>minecraft dqn client action &lt;id&gt;<br>minecraft dqn client release<br>minecraft dqn client title &lt;window-title-fragment&gt;<\/p>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Start in observe and dry-run, enable wall-guard and unstuck, then train<\/p>\n\n\n\n<p>in short sessions. Use minecraft dqn net on when you want the shared MathNN<\/p>\n\n\n\n<p>DQN path instead of the compact built-in model.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Gaming RL FPS<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>GamingRL.hpp\/.cpp<\/li>\n\n\n\n<li>docs\/GamingRL.md<\/li>\n\n\n\n<li>docs\/GamingRLFPS.md<\/li>\n\n\n\n<li>docs\/GameModBridges.md<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>FPS\/game RL observes target, HUD, movement, resource, objective, audio, and<\/p>\n\n\n\n<p>threat signals; chooses discrete actions; records transitions; supports dry-run,<\/p>\n\n\n\n<p>bot, assist, train, eval, and imitation workflows.<\/p>\n\n\n\n<p>State\/action shape:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>State size: 32 features.<\/li>\n\n\n\n<li>Action count: 24 discrete actions.<\/li>\n\n\n\n<li>Algorithms: heuristic, random, Q-table, Linear-Q, SARSA, REINFORCE, MLP, DQN,<\/li>\n<\/ul>\n\n\n\n<p>&nbsp; remote, and auto.<\/p>\n\n\n\n<p>Main commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>gaming rl status<br>gaming rl features<br>gaming rl systems<br>gaming rl skills<br>gaming rl explain<br>gaming rl why<br>gaming rl mode off|assist|bot|train|eval<br>gaming rl algorithm heuristic|qtable|linear_q|sarsa|reinforce|mlp|dqn|remote|auto<br>gaming rl train on|off|episode start|episode end<br>gaming rl eval [episodes]<br>gaming rl selfplay on|off<br>gaming rl adapter set &lt;name&gt;<br>gaming rl adapter status<br>gaming rl perception &lt;request&gt;<br>gaming rl input hold &lt;milliseconds&gt;<br>gaming rl input mouse &lt;max_pixels_per_tick&gt;<br>gaming rl dry-run on|off<br>gaming rl curriculum status<br>gaming rl curriculum start [phase]<br>gaming rl curriculum next<br>gaming rl replay summary [path]<br>gaming rl replay train [path]<br>gaming rl bc train [epochs]<br>gaming rl reward good|bad|&lt;number&gt; [note]<br>gaming rl dashboard<br>gaming rl heatmap<br>gaming rl bridge spec<br>gaming rl checkpoint tag|list|rollback<\/p>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Only use on private\/local games and servers. Start with dry-run and replay<\/p>\n\n\n\n<p>review. Do not use it to bypass anti-cheat or automate public multiplayer play.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Strategy Gaming RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>GamingStrategyRL.hpp\/.cpp<\/li>\n\n\n\n<li>docs\/GameModBridges.md<\/li>\n\n\n\n<li>game_mods\/civilization_mod\/README.md<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Strategy RL supports higher-level game decisions for League of Legends style<\/p>\n\n\n\n<p>observations and Civilization turn-strategy decisions.<\/p>\n\n\n\n<p>State\/action shape:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Feature size: 32.<\/li>\n\n\n\n<li>Maximum actions: 16.<\/li>\n\n\n\n<li>Game modes: League of Legends and Civilization.<\/li>\n<\/ul>\n\n\n\n<p>Capabilities:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Build League observations from FPS\/game perception plus champion detections.<\/li>\n\n\n\n<li>Build Civilization observations from turn, city, unit, economy, pressure, and<\/li>\n<\/ul>\n\n\n\n<p>&nbsp; victory-focus state.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Select strategy actions.<\/li>\n\n\n\n<li>Observe transitions.<\/li>\n\n\n\n<li>Train batches.<\/li>\n\n\n\n<li>Save\/load checkpoints.<\/li>\n<\/ul>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Use as a planning\/policy layer above game-specific perception. For Civilization,<\/p>\n\n\n\n<p>it is better suited to turn-level advisory or private mod integration than<\/p>\n\n\n\n<p>direct real-time control.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Driving RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>DrivingRL.hpp\/.cpp<\/li>\n\n\n\n<li>docs\/DrivingRL.md<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Driving RL is a simulation-first subsystem for lane keeping, lead following,<\/p>\n\n\n\n<p>intersections, traffic controls, pedestrian yielding, weather\/visibility, route<\/p>\n\n\n\n<p>progress, comfort, road-sign model response, and emergency braking.<\/p>\n\n\n\n<p>State\/action shape:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>State size: 32 features.<\/li>\n\n\n\n<li>Action count: 12 discrete actions.<\/li>\n\n\n\n<li>Algorithms: heuristic, Q-table, local MathNN DQN, auto.<\/li>\n\n\n\n<li>Modes: off, assist, train, eval.<\/li>\n\n\n\n<li>The active trained object-detection model can feed road-sign labels such as<\/li>\n<\/ul>\n\n\n\n<p>&nbsp; stop, yield, speed limit, traffic-light color, warning, crosswalk, and<\/p>\n\n\n\n<p>&nbsp; no-entry into the RL state vector.<\/p>\n\n\n\n<p>Main commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>driving rl status<br>driving rl features<br>driving rl actions<br>driving rl explain<br>driving rl dashboard<br>driving rl on|assist|train|eval|off<br>driving rl algorithm heuristic|qtable|dqn|auto<br>driving rl dqn on|off|status|save &lt;path&gt;|load &lt;path&gt;<br>driving rl scenario &lt;name&gt; [ticks]<br>driving rl curriculum status|start [phase]|next|phase &lt;name&gt;<br>driving rl adapter set &lt;name&gt;<br>driving rl adapter status<br>driving rl shield on|off<br>driving rl dry-run on|off<br>driving rl reward good|bad|&lt;value&gt;<br>driving rl checkpoint tag|list|rollback<br>driving rl save<br>driving rl load<\/p>\n\n\n\n<p>Driving-law training commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>driving rl law status<br>driving rl law mysql init<br>driving rl law seed &lt;STATE&gt;<br>driving rl law load [STATE]<br>driving rl law list [N]<br>driving rl law add &lt;federal|state&gt; &lt;jurisdiction&gt; &lt;trigger&gt; &lt;required_action&gt; &lt;severity&gt; &lt;citation&gt; &lt;summary&gt;<br>driving rl law on|off<br>driving rl law train [all|scenario] [ticks]<br>driving rl law explain<\/p>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Keep this in simulation\/review. Do not wire it directly to a real vehicle<\/p>\n\n\n\n<p>actuator. Use dry-run on and shield on by default.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Knowledge RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>KnowledgeAcquisitionRL.hpp\/.cpp<\/li>\n\n\n\n<li>docs\/KnowledgeRL.md<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Knowledge RL learns which claims to present, review, label, train, or evaluate.<\/p>\n\n\n\n<p>It tracks claim text, epistemic labels, source trust, conflicts, confidence,<\/p>\n\n\n\n<p>replay, and policy state.<\/p>\n\n\n\n<p>Modes:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>off<\/li>\n\n\n\n<li>acquire<\/li>\n\n\n\n<li>train<\/li>\n\n\n\n<li>eval<\/li>\n<\/ul>\n\n\n\n<p>Main commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>knowledge on<br>knowledge off<br>knowledge status<br>knowledge claim &lt;statement&gt;<br>knowledge next<br>knowledge true|false|depends|unknown<br>knowledge label true|false|depends|unknown &lt;claim&gt;<br>knowledge conflicts<br>knowledge trust &lt;source_or_claim&gt; &lt;0.0-1.0&gt;<br>knowledge save<br>knowledge load<br>knowledge save mysql<br>knowledge load mysql<br><br>knowledge rl status<br>knowledge rl observe<br>knowledge rl step<br>knowledge rl train replay [episodes]<br>knowledge rl eval<br>knowledge rl replay [limit]<br>knowledge rl benchmark [episodes]<br>knowledge rl explain<br>knowledge rl use<br>knowledge rl stats<br>knowledge rl graphs [directory]<\/p>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Use Knowledge RL to prioritize review and labeling, not as proof. It should<\/p>\n\n\n\n<p>surface conflicts, uncertainty, and source-trust issues before claims are used<\/p>\n\n\n\n<p>downstream.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Parenting \/ Child Psychology RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>ChildPsychologyParentingRL.hpp\/.cpp<\/li>\n\n\n\n<li>docs\/CHILD_PSYCHOLOGY_PARENTING_RL.md<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>This subsystem is a safety-bounded parenting coaching simulator. RL is limited<\/p>\n\n\n\n<p>to offline simulation, shadow-mode evaluation, and parent-facing suggestions.<\/p>\n\n\n\n<p>It is not a diagnostic or clinical decision system and never autonomously<\/p>\n\n\n\n<p>messages, disciplines, or directs a child.<\/p>\n\n\n\n<p>Main commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>parenting rl status<br>parenting rl domains<br>parenting rl safety<br>parenting rl actions<br>parenting rl curriculum<br>parenting rl observe &lt;de-identified situation text&gt;<br>parenting rl evaluate &lt;situation text&gt;<br>parenting rl train [episodes] [max_steps]<br>parenting rl export &lt;path&gt;<br>parenting rl reset<\/p>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Keep observations de-identified. Treat output as coaching suggestions for an<\/p>\n\n\n\n<p>adult caregiver, not medical, psychological, or emergency guidance.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Political News RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>PoliticalRL.hpp\/.cpp<\/li>\n\n\n\n<li>PoliticalRLCore.hpp<\/li>\n\n\n\n<li>lua_scripts\/Political-News-RL.lua<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Political RL is a local political-news triage agent. It uses a UCB1 feed<\/p>\n\n\n\n<p>portfolio bandit to choose RSS feeds, rewards novelty and relevance, extracts<\/p>\n\n\n\n<p>legislative bill mentions, and flags volume spikes.<\/p>\n\n\n\n<p>Main commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>politics status<br>politics tick [n]<br>politics brief [n]<br>politics bills<br>politics save<br>politics load<\/p>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Use for local analysis and triage only. Rewards are novelty, coverage, and<\/p>\n\n\n\n<p>relevance, not engagement or persuasion. Keep source links\/provenance attached.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Real-World RL Environments<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>RLReal.hpp\/.cpp<\/li>\n\n\n\n<li>RLRealEnvs.hpp\/.cpp<\/li>\n\n\n\n<li>RLDeployment.hpp\/.cpp<\/li>\n\n\n\n<li>RL_REALWORLD.md<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Real-world RL registers RLEnv implementations that can observe real systems<\/p>\n\n\n\n<p>and optionally actuate through host hooks. The deployment gate decides whether<\/p>\n\n\n\n<p>any action may execute.<\/p>\n\n\n\n<p>Built-in environment:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>llm_routing: contextual bandit over the NetLLM backend pool. This is the<\/li>\n<\/ul>\n\n\n\n<p>&nbsp; recommended first live RL environment because it has no physical actuation.<\/p>\n\n\n\n<p>Hook-driven presets:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Desktop automation<\/li>\n\n\n\n<li>Perception tuning<\/li>\n\n\n\n<li>Home IoT<\/li>\n\n\n\n<li>Fleet remediation<\/li>\n\n\n\n<li>ROS robot<\/li>\n<\/ul>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Start with rl real route or llm_routing. Keep physical or operational<\/p>\n\n\n\n<p>domains in sim, offline, or shadow until checkpoints are promoted and<\/p>\n\n\n\n<p>action gates pass.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Differential \/ Physics RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>RLDifferential.hpp\/.cpp<\/li>\n\n\n\n<li>MathControl.hpp\/.cpp<\/li>\n\n\n\n<li>MathODE components<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Differential RL connects RL to physical dynamics and control theory.<\/p>\n\n\n\n<p>Capabilities:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>CartPole RLEnv with RK4-integrated ODE dynamics.<\/li>\n\n\n\n<li>Ornstein-Uhlenbeck exploration noise for continuous control.<\/li>\n\n\n\n<li>Return-stability tripwire.<\/li>\n\n\n\n<li>Reachability checks and control-barrier style safety gates.<\/li>\n<\/ul>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Use for physics simulator smoke tests, robotics-like control experiments, and<\/p>\n\n\n\n<p>safe-RL verification before connecting policies to real actuators.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Distributed RL \/ RLAIF \/ Offline RL<\/h3>\n\n\n\n<p>Files:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>RLDistributed.hpp\/.cpp<\/li>\n<\/ul>\n\n\n\n<p>Purpose:<\/p>\n\n\n\n<p>Distributed RL lets multiple actors push transitions to a learner, publish<\/p>\n\n\n\n<p>parameters back to actors, run population-based training, load offline datasets,<\/p>\n\n\n\n<p>and use LLM-based reward\/preference scoring.<\/p>\n\n\n\n<p>Capabilities:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Transition serialization and parsing.<\/li>\n\n\n\n<li>Actor-to-learner transition push.<\/li>\n\n\n\n<li>Incoming learner queue.<\/li>\n\n\n\n<li>Parameter publishing\/pulling.<\/li>\n\n\n\n<li>Population-based training reports and exploit\/explore config mutation.<\/li>\n\n\n\n<li>RLAIF trajectory scoring and pairwise preference scoring.<\/li>\n\n\n\n<li>Offline dataset loading into replay buffers.<\/li>\n<\/ul>\n\n\n\n<p>Recommended use:<\/p>\n\n\n\n<p>Use when training data is generated across machines or domains. Keep the reward<\/p>\n\n\n\n<p>rubric explicit when using RLAIF, and audit LLM-scored rewards before treating<\/p>\n\n\n\n<p>them as training signal.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Curriculum Domain Catalog<\/h2>\n\n\n\n<p>RLCurriculumOrchestrator exposes the broad catalog and safe smoke tests. Run:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl curriculum domains<br>rl curriculum domain &lt;id&gt;<\/p>\n\n\n\n<p>Current catalog IDs include:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Domain ID<\/strong><\/td><td><strong>Category<\/strong><\/td><td><strong>Smoke<\/strong><\/td><td><strong>Purpose<\/strong><\/td><\/tr><tr><td>knowledge_rl<\/td><td>knowledge<\/td><td>yes<\/td><td>Claim triage, critique, and memory-consolidation checks.<\/td><\/tr><tr><td>gaming_rl<\/td><td>gaming<\/td><td>yes<\/td><td>Navigation, stuck recovery, resource timing, and reward shaping.<\/td><\/tr><tr><td>game_simulator<\/td><td>gaming<\/td><td>yes<\/td><td>Deterministic grid navigation and obstacle handling.<\/td><\/tr><tr><td>physics_simulator<\/td><td>simulation<\/td><td>yes<\/td><td>Force and trajectory control using local physics dynamics.<\/td><\/tr><tr><td>robot_simulator<\/td><td>robotics<\/td><td>yes<\/td><td>Differential-drive navigation with collision and boundary penalties.<\/td><\/tr><tr><td>robotics_gazebo<\/td><td>robotics<\/td><td>yes<\/td><td>ROS\/Gazebo navigation and manipulation staging.<\/td><\/tr><tr><td>ros_robot<\/td><td>robotics<\/td><td>no<\/td><td>Real ROS\/hardware bridge placeholder registered at Sim.<\/td><\/tr><tr><td>cybersecurity_soc<\/td><td>security<\/td><td>yes<\/td><td>Alert triage, evidence collection, ranking, and escalation.<\/td><\/tr><tr><td>windows_ops<\/td><td>operations<\/td><td>yes<\/td><td>Ticket triage, patching, diagnostics, rollback planning, and audits.<\/td><\/tr><tr><td>software_build<\/td><td>software<\/td><td>yes<\/td><td>Build, test, lint, bisect, retry, rollback, and documentation choices.<\/td><\/tr><tr><td>research_science<\/td><td>research<\/td><td>yes<\/td><td>Literature review, hypothesis selection, experiment planning, and replication.<\/td><\/tr><tr><td>healthcare_triage<\/td><td>healthcare<\/td><td>yes<\/td><td>Intake, guideline lookup, risk flags, and human escalation.<\/td><\/tr><tr><td>education_tutoring<\/td><td>education<\/td><td>yes<\/td><td>Hinting, examples, retrieval practice, review, and assessment timing.<\/td><\/tr><tr><td>math_algebra<\/td><td>mathematics<\/td><td>yes<\/td><td>Algebra step selection for MathNN DQN tutoring smoke\/training.<\/td><\/tr><tr><td>math_geometry<\/td><td>mathematics<\/td><td>yes<\/td><td>Geometry theorem and measurement tutoring for MathNN.<\/td><\/tr><tr><td>math_trigonometry<\/td><td>mathematics<\/td><td>yes<\/td><td>Trigonometry identity and ratio tutoring for MathNN.<\/td><\/tr><tr><td>math_probability_statistics<\/td><td>mathematics<\/td><td>yes<\/td><td>Probability\/stats workflow tutoring for MathNN.<\/td><\/tr><tr><td>math_linear_algebra<\/td><td>mathematics<\/td><td>yes<\/td><td>Linear algebra matrix\/system tutoring for MathNN.<\/td><\/tr><tr><td>math_finite_math<\/td><td>mathematics<\/td><td>yes<\/td><td>Finite math (sets, combinatorics, LP, graphs) for MathNN.<\/td><\/tr><tr><td>child_parenting<\/td><td>parenting<\/td><td>yes<\/td><td>Routines, de-escalation, boundaries, choices, and safety escalation.<\/td><\/tr><tr><td>finance_portfolio<\/td><td>finance<\/td><td>yes<\/td><td>Allocation, risk balancing, rebalance timing, and drawdown-aware simulation.<\/td><\/tr><tr><td>stock_research<\/td><td>finance<\/td><td>yes<\/td><td>RSS reading, sentiment checks, fundamentals review, and watchlist updates.<\/td><\/tr><tr><td>product_recommendation<\/td><td>commerce<\/td><td>yes<\/td><td>Relevance, diversity, safety filtering, preference questions, and audits.<\/td><\/tr><tr><td>sales_pricing<\/td><td>commerce<\/td><td>yes<\/td><td>Offer timing, guarded discounts, follow-up cadence, and churn handling.<\/td><\/tr><tr><td>supply_chain<\/td><td>operations<\/td><td>yes<\/td><td>Reorder, supplier, routing, buffer stock, and disruption response.<\/td><\/tr><tr><td>energy_grid<\/td><td>infrastructure<\/td><td>yes<\/td><td>Load forecasting, storage dispatch, outage response, and demand shifting.<\/td><\/tr><tr><td>legal_research<\/td><td>legal<\/td><td>yes<\/td><td>Statute\/case lookup, issue spotting, citation checks, and attorney escalation.<\/td><\/tr><tr><td>civic_policy<\/td><td>government<\/td><td>yes<\/td><td>Stakeholder tradeoffs, sequencing, equity checks, review, and audits.<\/td><\/tr><tr><td>manufacturing_quality<\/td><td>manufacturing<\/td><td>yes<\/td><td>Inspection, calibration, sampling, rework, and line-stop recommendations.<\/td><\/tr><tr><td>media_workflow<\/td><td>creative<\/td><td>yes<\/td><td>Ingest, tagging, edit queues, rendering, captioning, and publishing review.<\/td><\/tr><tr><td>personal_productivity<\/td><td>personal<\/td><td>yes<\/td><td>Prioritization, scheduling, focus blocks, breaks, reminders, and review.<\/td><\/tr><tr><td>smart_home<\/td><td>iot<\/td><td>yes<\/td><td>Comfort, energy, notifications, fallback-safe automation, and audit policy.<\/td><\/tr><tr><td>fleet_maintenance<\/td><td>operations<\/td><td>yes<\/td><td>Inspection, preventive service, parts staging, rerouting, and downtime reduction.<\/td><\/tr><tr><td>call_center<\/td><td>customer_ops<\/td><td>yes<\/td><td>Routing, response suggestions, clarifying questions, escalation, and QA.<\/td><\/tr><tr><td>llm_routing<\/td><td>llm<\/td><td>no<\/td><td>Backend selection by latency, quality, cost, and task fit.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>The generic smoke domains use synthetic observations and safe action families.<\/p>\n\n\n\n<p>They do not touch external services.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Training And Evaluation Workflow<\/h2>\n\n\n\n<p>Use this sequence for any new RL domain:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Define the state vector and normalize every feature.<\/li>\n\n\n\n<li>Define the action library and legal-action rules.<\/li>\n\n\n\n<li>Define reward, terminal, and truncation conditions.<\/li>\n\n\n\n<li>Run synthetic or simulator smoke tests first.<\/li>\n\n\n\n<li>Log transitions and inspect replay before training long sessions.<\/li>\n\n\n\n<li>Start with tabular\/Q-table or local MathNN DQN.<\/li>\n\n\n\n<li>Add neural or remote deep-RL training only after the domain loop is correct.<\/li>\n\n\n\n<li>Evaluate with exploration disabled.<\/li>\n\n\n\n<li>Save and tag checkpoints.<\/li>\n\n\n\n<li>Promote only if evaluation clears the threshold and safety review passes.<\/li>\n\n\n\n<li>Move to shadow mode before any live actuation.<\/li>\n\n\n\n<li>Use gated live mode before live mode.<\/li>\n<\/ul>\n\n\n\n<p>Useful first commands:<\/p>\n\n\n\n<p><em>[text]<br><\/em>rl curriculum smoke all 8 96<br>rl curriculum next<br>rl net status<br>rl real envs<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Safety Model<\/h2>\n\n\n\n<p>RL systems in this project should be treated as action-selection systems, not<\/p>\n\n\n\n<p>general-purpose truth engines. The safe pattern is:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Simulation first.<\/li>\n\n\n\n<li>Offline replay second.<\/li>\n\n\n\n<li>Shadow mode before actuation.<\/li>\n\n\n\n<li>Gated live before live.<\/li>\n\n\n\n<li>Promoted checkpoints only.<\/li>\n\n\n\n<li>Safe-action shields always on for high-impact domains.<\/li>\n\n\n\n<li>Kill switch and manual override available.<\/li>\n\n\n\n<li>Human approval for healthcare, parenting, finance, legal, infrastructure,<\/li>\n<\/ul>\n\n\n\n<p>&nbsp; driving, robotics, cybersecurity, and desktop\/Windows automation.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Documentation Map<\/h2>\n\n\n\n<p>Detailed docs:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>docs\/MathNN.md<\/li>\n\n\n\n<li>docs\/RLCurriculum.md<\/li>\n\n\n\n<li>docs\/KnowledgeRL.md<\/li>\n\n\n\n<li>docs\/DrivingRL.md<\/li>\n\n\n\n<li>docs\/GamingRL.md<\/li>\n\n\n\n<li>docs\/GamingRLFPS.md<\/li>\n\n\n\n<li>docs\/MinecraftPluginTrainingGuide.md<\/li>\n\n\n\n<li>docs\/MinecraftPluginOperations.md<\/li>\n\n\n\n<li>docs\/MinecraftIntegration.md<\/li>\n\n\n\n<li>docs\/GameModBridges.md<\/li>\n\n\n\n<li>docs\/CHILD_PSYCHOLOGY_PARENTING_RL.md<\/li>\n\n\n\n<li>docs\/SimpleAgents.md<\/li>\n<\/ul>\n\n\n\n<p>Legacy\/reference docs:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>RL_FEATURES.md<\/li>\n\n\n\n<li>RL_REALWORLD.md<\/li>\n\n\n\n<li>ML_APPLICATIONS.md<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Short Summary<\/h2>\n\n\n\n<p>The RL stack has a reusable C++ substrate, multiple local algorithms, MathNN DQN<\/p>\n\n\n\n<p>support, distributed\/offline hooks, a broad curriculum catalog, and several<\/p>\n\n\n\n<p>domain-specific systems. The highest-value operational habit is to separate<\/p>\n\n\n\n<p>learning from actuation: train and test in simulation or offline replay, inspect<\/p>\n\n\n\n<p>behavior, save checkpoints, evaluate, then advance through the deployment ladder<\/p>\n\n\n\n<p>only when the policy is measurably better and safety gates pass.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This document is the map of the reinforcement-learning surface in _AugmentedIntelligence. It explains the shared RL infrastructure, the domain modules, the training\/deployment ladder, and the commands used to inspect or run the systems. For MathNN details, see docs\/MathNN.md. For the live curriculum catalog, see docs\/RLCurriculum.md. Big Picture The RL stack has three layers: &nbsp;&nbsp; algorithms, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2065","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/2065","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/comments?post=2065"}],"version-history":[{"count":1,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/2065\/revisions"}],"predecessor-version":[{"id":2066,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/2065\/revisions\/2066"}],"wp:attachment":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/media?parent=2065"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/categories?post=2065"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/tags?post=2065"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}