_AugmentedIntelligence Documentation

What it Does

  1. Inform the user about recording consent laws
  2. Record still frames from a webcam or video recording device
  3. Record audio from microphone
  4. Get transcription with Whisper from the microphone
  5. Get Speech Command keyword
  6. Get speech command command transcribed with Whisper for transcription
    • Find Trigonometric functions calculation of variable
    • Search Wikipedia, Wikisimple, Wikihow, Wikiquote, Wikisource, books/literature, dictionary, Word vectors,
    • Create prompt for Large Language Models
    • Calculate Algebraic, Geometric, Trigonometric, Calculus, Differential Equations, and Statistics functions
    • Create deductive arguments from text
    • Create Inductive arguments from text
    • Fallacy check working memory, last x seconds, and and prepared text
    • Bias check working memory, last x seconds, and prepared text
    • Translate any language to English form working memory, last x seconds, prepared text
    • Translate English to any language from working memory, last x seconds, prepared text
    • Find the last time user has seen an item, show last location
    • Part of speech tag working memory, reading, and last x sentences
    • Driving mode // work in progress
    • Reading mode // work in progress
    • Add data to a string and use in previous commands
    • Get a setting value
    • Change a setting
    • Manual Memory Management of Working, Short Term, and Long Term Memory Arrays/Apparatus
    • Image Analysis
    • Memory Search Engines // Work in Progress
    • On the saved image use Tensorflow object detection and save image of detections
  7. Save record/row of image into MySQL with object detection classes and analysis of image if enabled
  8. Save record/row of wav file to MySQL with transcription and date
  9. Save to Short-Term Memory variables/array/apparatus
  10. FTP memory upload for long term storage
  11. Court room objections listening
  12. Axioms detection listening
  13. Fallacy check listening
  14. Bias Check listening
  15. Law Checking listening
  16. Remote LLM Server capability
  17. Bible verse search

What I Want it To Do

  1. Speech Commands
  2. Writing mode
  3. Cheating … using LLM?
  4. Not so cheating?
  5. There should be a method that enables
  6. Various Sports modes
  7. Class mode vocabulary detection
  8. Memory Management
  9. Programming mode
  10. Gaming mode
  11. Household chore mode
  12. Computer Troubleshooting mode
  13. Problem solving mode
  14. Automation
  15. Computer Use mode
    • Private computer mode
    • Image detection mode
    • Application profiles
  16. Wikihow articles integration
  17. LLM Example prompts
  18. NLU (Natural Language Understanding)
  19. Learning?
  20. Remote Object Detection
  21. Typing mode?
  22. Speech
  23. Reasoning mode
  24. Profiles
  25. Faster than now Reasoning

What It Should Not Be

  1. A way for people to judge others
  2. A way for people to hurt or harm others

Installation Instructions

  1. Boot a Windows Machine like a laptop or desktop, there are several modes that will fit your use case.
  2. Download _AugmentedIntelligence if you have not already from the following link:
  3. Download and install Ollama
    • After downloading Ollama, search https://ollama.com/library for a language model you like
    • Run: ollama run xxx:x where ‘xxx’ is the model and type of install in Command Prompt
    • Run: ollama serve
  4. After downloading Ollama, search https://ollama.com/library for a language model you like
  5. Download and install MySQL Community
  6. Extract the _AugmentedIntelligenece.zip file. Recommended to C:/_AugmentedIntelligence
  7. Open Command prompt and type: mysql -u root -p    a. Press enter, then enter the your chosen MySQL password
  8. Inside the extracted directory there should be an ‘localhost.sql’ file.
  9. Move the localhost.sql file to a directory that is simple to write down and write. Example: C:/localhost.sql
  10. in CMD: ‘source C:/localhost.sql’ or the path of the file which will import the sql file
  11. The extracted directory, open the RTAudioDevices.exe in the command line
  12. Note: that you need two microphones to run AugmentedIntelligence
  13. One Microphone for global speech recognition and the other for voice commands
  14. Use the RTAudioDevices.exe to find your microphone ids, these will be used within _AugmentedIntelligence.exe
  15. The executable is located in ../x64/Release/AugmentedIntelligence
  16. All of the .dll files must be installed in the same folder as the executable!
  17. The execuable must be run as an Administrator!
  18. Configure the app in the settings to fit your use case
  19. Run the program!

For compiling and Editing

  1. Follow steps 1-6 …
  2. Download and install Visual Studio 2022 Community
  3. Navigate the Installation directory which should be under :
    • C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.41.34120
  4. Copy and paste everything in the ../include directory of _AugmentedIntelligence into the ../include directory of Visual Studio.
  5. Open Visual Studio 2022 and the _AugmentedIntelligence.sln file

Leave a Reply

Your email address will not be published. Required fields are marked *

Filed under: Uncategorized - @ January 21, 2025 9:10 am