{"id":2063,"date":"2026-07-18T06:51:05","date_gmt":"2026-07-18T13:51:05","guid":{"rendered":"http:\/\/macdaddy4sure.ai\/?p=2063"},"modified":"2026-07-18T06:51:05","modified_gmt":"2026-07-18T13:51:05","slug":"rl-curriculum-orchestrator","status":"publish","type":"post","link":"http:\/\/macdaddy4sure.ai\/index.php\/2026\/07\/18\/rl-curriculum-orchestrator\/","title":{"rendered":"RL Curriculum Orchestrator"},"content":{"rendered":"\n<p>RLCurriculumOrchestrator connects the RL domains that were split across the<\/p>\n\n\n\n<p>project and the expanded RL domain catalog: Knowledge RL, Gaming RL, game and<\/p>\n\n\n\n<p>physics simulation, robot\/Gazebo simulation, cybersecurity, Windows operations,<\/p>\n\n\n\n<p>software build\/test, research, healthcare, tutoring, parenting, finance, stocks,<\/p>\n\n\n\n<p>commerce, operations, infrastructure, legal, policy, manufacturing, creative<\/p>\n\n\n\n<p>workflows, productivity, IoT, fleet maintenance, call-center support, ROS\/robot<\/p>\n\n\n\n<p>hooks, and real-world deployment gates.<\/p>\n\n\n\n<p><strong>RL hub (start here):<\/strong> ReinforcementLearning.md (ReinforcementLearning.md)<\/p>\n\n\n\n<p>Related subsystem docs:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>docs\/RLDomains.md<\/li>\n\n\n\n<li>docs\/MathNN.md \u2014 in-process neural policies (rl net, learners)<\/li>\n\n\n\n<li>docs\/LifeRL.md \u2014 advisory multi-domain life RL<\/li>\n\n\n\n<li>docs\/KnowledgeRL.md<\/li>\n\n\n\n<li>docs\/GamingRL.md<\/li>\n\n\n\n<li>docs\/DrivingRL.md<\/li>\n\n\n\n<li>docs\/MinecraftPluginTrainingGuide.md<\/li>\n\n\n\n<li>docs\/SimpleAgents.md<\/li>\n<\/ul>\n\n\n\n<p>The simulator smoke tests are non-actuating. They train tiny tabular policies<\/p>\n\n\n\n<p>against safe synthetic RLEnv environments so the RL loop can be checked before<\/p>\n\n\n\n<p>anything touches Minecraft, Windows automation, ROS, or hardware.<\/p>\n\n\n\n<p>Neural (MathNN) training is separate: use rl net \u2026, rl cartpole, domain<\/p>\n\n\n\n<p>net on flags, or nn math train \u2026 after smoke passes.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Commands<\/h2>\n\n\n\n<p><em>[text]<br><\/em>rl status<br>rl curriculum status<br>rl curriculum plan<br>rl curriculum next<br>rl curriculum domains [category]<br>rl curriculum domain &lt;id&gt;<br>rl curriculum envs<br>rl curriculum smoke all [episodes] [max_steps]<br>rl curriculum smoke knowledge [episodes] [max_steps]<br>rl curriculum smoke game [episodes] [max_steps]<br>rl curriculum smoke physics [episodes] [max_steps]<br>rl curriculum smoke robot [episodes] [max_steps]<br>rl curriculum smoke cybersecurity [episodes] [max_steps]<br>rl curriculum smoke healthcare [episodes] [max_steps]<br>rl curriculum smoke mathematics [episodes] [max_steps]<br>rl curriculum export [path]<br><br>rl domains [category]<br>rl domain &lt;id&gt;<br>rl sim game smoke [episodes] [max_steps]<br>rl sim physics smoke [episodes] [max_steps]<br>rl sim robot smoke [episodes] [max_steps]<br>rl sim energy smoke [episodes] [max_steps]<br>rl sim windows smoke [episodes] [max_steps]<br><br>rl net status<br>rl net modes<br>rl net enable &lt;agent&gt;<br>rl net mode &lt;agent&gt; &lt;dqn|dueling-dqn|actor-critic|bandit|hierarchical|multihead-dueling|worldmodel|reward-model&gt;<br>rl net save|load &lt;agent&gt; &lt;path&gt;<br>rl net reward &lt;agent&gt; good|bad<br>rl net wm|rm &lt;agent&gt; on|off<br><br>rl cartpole [episodes] [dueling|a2c|hierarchical|multihead] [shield] [tripwire] [curiosity]<br>rl life status|smoke|suggest&nbsp;&nbsp; # alias of life rl \u2026<br><br>rl real envs<br>rl real stage &lt;agent&gt; &lt;sim|offline|shadow|gatedlive|live&gt;<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Domains<\/h2>\n\n\n\n<p>Run rl curriculum domains to print the live catalog. Run<\/p>\n\n\n\n<p>rl curriculum domain &lt;id&gt; to print actions, safety model, deployment stage,<\/p>\n\n\n\n<p>and a ready-to-run smoke command for a single domain.<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><strong>Domain<\/strong><\/td><td><strong>Category<\/strong><\/td><td><strong>Smoke<\/strong><\/td><td><strong>Purpose<\/strong><\/td><\/tr><tr><td>knowledge_rl<\/td><td>knowledge<\/td><td>yes<\/td><td>Synthetic claim triage, critique, and memory-consolidation policy checks.<\/td><\/tr><tr><td>gaming_rl<\/td><td>gaming<\/td><td>yes<\/td><td>Game\/FPS navigation, stuck recovery, resource timing, and reward shaping.<\/td><\/tr><tr><td>game_simulator<\/td><td>gaming<\/td><td>yes<\/td><td>Deterministic grid navigation and obstacle handling.<\/td><\/tr><tr><td>physics_simulator<\/td><td>simulation<\/td><td>yes<\/td><td>Force and trajectory control using local physics dynamics.<\/td><\/tr><tr><td>robot_simulator<\/td><td>robotics<\/td><td>yes<\/td><td>Differential-drive navigation with collision and boundary penalties.<\/td><\/tr><tr><td>robotics_gazebo<\/td><td>robotics<\/td><td>yes<\/td><td>ROS\/Gazebo navigation, manipulation, recovery, and sensor-fusion staging.<\/td><\/tr><tr><td>ros_robot<\/td><td>robotics<\/td><td>no<\/td><td>Real ROS\/hardware bridge placeholder, registered at Sim by default.<\/td><\/tr><tr><td>cybersecurity_soc<\/td><td>security<\/td><td>yes<\/td><td>Alert triage, evidence collection, incident ranking, and escalation policy.<\/td><\/tr><tr><td>windows_ops<\/td><td>operations<\/td><td>yes<\/td><td>Ticket triage, patch scheduling, diagnostics, rollback planning, and audits.<\/td><\/tr><tr><td>software_build<\/td><td>software<\/td><td>yes<\/td><td>Build, test, lint, bisect, retry, rollback, and documentation choices.<\/td><\/tr><tr><td>research_science<\/td><td>research<\/td><td>yes<\/td><td>Literature review, hypothesis selection, experiment planning, and replication.<\/td><\/tr><tr><td>healthcare_triage<\/td><td>healthcare<\/td><td>yes<\/td><td>Intake questions, guideline lookup, risk flags, and human escalation.<\/td><\/tr><tr><td>education_tutoring<\/td><td>education<\/td><td>yes<\/td><td>Hinting, examples, retrieval practice, review, and assessment timing.<\/td><\/tr><tr><td>child_parenting<\/td><td>parenting<\/td><td>yes<\/td><td>Supportive routines, de-escalation, boundaries, choices, and safety escalation.<\/td><\/tr><tr><td>finance_portfolio<\/td><td>finance<\/td><td>yes<\/td><td>Allocation, risk balancing, rebalance timing, and drawdown-aware simulation.<\/td><\/tr><tr><td>stock_research<\/td><td>finance<\/td><td>yes<\/td><td>RSS reading, sentiment checks, fundamentals review, and watchlist updates.<\/td><\/tr><tr><td>product_recommendation<\/td><td>commerce<\/td><td>yes<\/td><td>Relevance, diversity, safety filtering, preference questions, and audits.<\/td><\/tr><tr><td>sales_pricing<\/td><td>commerce<\/td><td>yes<\/td><td>Offer timing, guarded discounting, follow-up cadence, and churn handling.<\/td><\/tr><tr><td>supply_chain<\/td><td>operations<\/td><td>yes<\/td><td>Reorder, supplier, routing, buffer stock, and disruption-response policies.<\/td><\/tr><tr><td>energy_grid<\/td><td>infrastructure<\/td><td>yes<\/td><td>Load forecasting, storage dispatch, outage response, and demand shifting.<\/td><\/tr><tr><td>legal_research<\/td><td>legal<\/td><td>yes<\/td><td>Statute\/case lookup, issue spotting, citation checks, and attorney escalation.<\/td><\/tr><tr><td>civic_policy<\/td><td>government<\/td><td>yes<\/td><td>Stakeholder tradeoffs, sequencing, equity checks, review, and policy audits.<\/td><\/tr><tr><td>manufacturing_quality<\/td><td>manufacturing<\/td><td>yes<\/td><td>Inspection, calibration, sampling, rework, and line-stop recommendations.<\/td><\/tr><tr><td>media_workflow<\/td><td>creative<\/td><td>yes<\/td><td>Ingest, tagging, edit queues, rendering, captioning, and publishing review.<\/td><\/tr><tr><td>personal_productivity<\/td><td>personal<\/td><td>yes<\/td><td>Prioritization, scheduling, focus blocks, breaks, reminders, and review.<\/td><\/tr><tr><td>smart_home<\/td><td>iot<\/td><td>yes<\/td><td>Comfort, energy, notifications, fallback-safe automation, and audit policy.<\/td><\/tr><tr><td>fleet_maintenance<\/td><td>operations<\/td><td>yes<\/td><td>Inspection, preventive service, parts staging, rerouting, and downtime reduction.<\/td><\/tr><tr><td>call_center<\/td><td>customer_ops<\/td><td>yes<\/td><td>Routing, response suggestions, clarifying questions, escalation, and QA.<\/td><\/tr><tr><td>llm_routing<\/td><td>llm<\/td><td>no<\/td><td>Backend selection by latency, quality, cost, and task fit.<\/td><\/tr><tr><td>math_algebra<\/td><td>mathematics<\/td><td>yes<\/td><td>Parsing, simplification, factoring, and equation-solving tutoring steps.<\/td><\/tr><tr><td>math_geometry<\/td><td>mathematics<\/td><td>yes<\/td><td>Theorem application, measurement, and proof-construction tutoring.<\/td><\/tr><tr><td>math_trigonometry<\/td><td>mathematics<\/td><td>yes<\/td><td>Unit-circle, ratio, identity, and law-of-sines\/cosines tutoring.<\/td><\/tr><tr><td>math_probability_statistics<\/td><td>mathematics<\/td><td>yes<\/td><td>Events, Bayes updates, descriptive stats, and hypothesis-test workflows.<\/td><\/tr><tr><td>math_linear_algebra<\/td><td>mathematics<\/td><td>yes<\/td><td>Matrix ops, systems, rank\/eigen analysis, and transformations.<\/td><\/tr><tr><td>math_finite_math<\/td><td>mathematics<\/td><td>yes<\/td><td>Sets\/logic, combinatorics, Markov chains, LP, and graph reasoning.<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p>Run rl curriculum smoke mathematics or nn math smoke mathematics to smoke all<\/p>\n\n\n\n<p>six mathematics domains. Use nn math train &lt;domain_id&gt; for MathNN DQN training.<\/p>\n\n\n\n<p>The generic smoke domains use a synthetic eight-value observation:<\/p>\n\n\n\n<p>progress, quality, risk, uncertainty, budget, compliance, load, time. Their<\/p>\n\n\n\n<p>actions are catalog-specific labels, but the smoke environment maps them into<\/p>\n\n\n\n<p>safe policy families: observe, optimize, explore, escalate, recover\/fallback,<\/p>\n\n\n\n<p>and audit\/deploy. These smoke tests do not touch external services.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Training Flow<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Prove MathNN: nn demo, optional rl cartpole 50.<\/li>\n\n\n\n<li>Run rl curriculum smoke all 8 96.<\/li>\n\n\n\n<li>Check rl curriculum status and rl curriculum next.<\/li>\n\n\n\n<li>Repeat smoke runs with more episodes for weak domains.<\/li>\n\n\n\n<li>For math tutoring domains: nn math smoke mathematics \/ nn math train &lt;id>.<\/li>\n\n\n\n<li>For Life RL (advisory): life rl smoke all 8 then life rl suggest \u2026.<\/li>\n\n\n\n<li>Train real game\/Minecraft policies only after simulator returns improve.<\/li>\n<\/ol>\n\n\n\n<p>&nbsp;&nbsp; Minecraft: dry-run \u2192 minecraft dqn net on \u2192 short train; optional<\/p>\n\n\n\n<p>&nbsp;&nbsp; minecraft dqn plan on for Executive setup steps.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>For high-stakes domains such as healthcare, parenting, finance, legal,<\/li>\n<\/ul>\n\n\n\n<p>&nbsp;&nbsp; cybersecurity, infrastructure, and robotics, keep training synthetic or<\/p>\n\n\n\n<p>&nbsp;&nbsp; logged-data only until evaluation is strong and the safety model is reviewed.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Keep real-world domains in Sim or Offline until a checkpoint is promoted.<\/li>\n\n\n\n<li>Move through Sim -> Offline -> Shadow -> GatedLive -> Live using<\/li>\n<\/ul>\n\n\n\n<p>&nbsp;&nbsp;&nbsp; rl real stage &#8230; and the existing RLDeployment gates.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Save neural checkpoints: rl net save &lt;agent> &lt;path>.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Lua Helpers<\/h2>\n\n\n\n<p><em>[lua]<br><\/em>ai_rl_status()<br>ai_rl_seed(n)<br>ai_rl_curriculum_status()<br>ai_rl_curriculum_plan()<br>ai_rl_domains()<br>ai_rl_domains(&#8220;finance&#8221;)<br>ai_rl_domain(&#8220;healthcare&#8221;)<br>ai_rl_curriculum_domains()<br>ai_rl_curriculum_domain(&#8220;cybersecurity_soc&#8221;)<br>ai_nn_modes()<br>ai_nn_policy_enable(&#8220;life&#8221;, &#8220;dueling-dqn&#8221;, 16, 8)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>RLCurriculumOrchestrator connects the RL domains that were split across the project and the expanded RL domain catalog: Knowledge RL, Gaming RL, game and physics simulation, robot\/Gazebo simulation, cybersecurity, Windows operations, software build\/test, research, healthcare, tutoring, parenting, finance, stocks, commerce, operations, infrastructure, legal, policy, manufacturing, creative workflows, productivity, IoT, fleet maintenance, call-center support, ROS\/robot hooks, and [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-2063","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/2063","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/comments?post=2063"}],"version-history":[{"count":1,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/2063\/revisions"}],"predecessor-version":[{"id":2064,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/posts\/2063\/revisions\/2064"}],"wp:attachment":[{"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/media?parent=2063"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/categories?post=2063"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/macdaddy4sure.ai\/index.php\/wp-json\/wp\/v2\/tags?post=2063"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}