|
| 1 | +# CAIOS — Andrew | Quick Setup Guide |
| 2 | + |
| 3 | +> **What you need before starting:** |
| 4 | +> - A computer with **16 GB RAM** recommended (8 GB works for smaller models) |
| 5 | +> - An internet connection for the initial download |
| 6 | +> - About 20 GB of free disk space (for the AI model) |
| 7 | +> - At least 8 GB of VRAM |
| 8 | +
|
| 9 | +See Hardware Notes at the bottom for details. |
| 10 | + |
| 11 | +--- |
| 12 | + |
| 13 | +## Windows |
| 14 | + |
| 15 | +### Step 1 — Install Python |
| 16 | +1. Go to **https://www.python.org/downloads/** |
| 17 | +2. Click the big yellow "Download Python 3.x" button |
| 18 | +3. Run the installer — **check the box that says "Add Python to PATH"** before clicking Install |
| 19 | + |
| 20 | +### Step 2 — Install Ollama |
| 21 | +1. Go to **https://ollama.com/download** |
| 22 | +2. Click "Download for Windows" and run the installer |
| 23 | +3. When it finishes, Ollama runs in the background automatically |
| 24 | + |
| 25 | +### Step 3 — Run the setup script |
| 26 | +1. Open the `Project_Andrew` folder |
| 27 | +2. Double-click **`run_caios.bat`** |
| 28 | +3. A terminal window opens and walks through the rest automatically: |
| 29 | + - Installs required packages |
| 30 | + - Downloads the AI model (~15 GB, takes 10–30 min depending on connection) |
| 31 | + - Starts the web interface |
| 32 | +4. When you see **"Web UI: http://localhost:5000"**, open that address in your browser |
| 33 | + |
| 34 | +> **Next time:** Just double-click `run_caios.bat` again — setup is skipped and it launches directly. |
| 35 | +
|
| 36 | +--- |
| 37 | + |
| 38 | +## macOS |
| 39 | + |
| 40 | +### Step 1 — Install Homebrew (if you don't have it) |
| 41 | +Open **Terminal** (press Cmd+Space, type Terminal, press Enter) and paste: |
| 42 | +``` |
| 43 | +/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)" |
| 44 | +``` |
| 45 | +Follow the prompts. This only needs to be done once. |
| 46 | + |
| 47 | +### Step 2 — Install Python |
| 48 | +``` |
| 49 | +brew install python@3.12 |
| 50 | +``` |
| 51 | + |
| 52 | +### Step 3 — Run the setup script |
| 53 | +In Terminal, navigate to the Project_Andrew folder: |
| 54 | +``` |
| 55 | +cd /path/to/Project_Andrew |
| 56 | +chmod +x run_caios.sh |
| 57 | +./run_caios.sh |
| 58 | +``` |
| 59 | +The script installs Ollama automatically via Homebrew, downloads the model, and starts the interface. |
| 60 | + |
| 61 | +When you see **"Web UI: http://localhost:5000"**, open that in Safari or Chrome. |
| 62 | + |
| 63 | +> **Apple Silicon (M1/M2/M3/M4):** Runs especially well — the unified memory means a 32 GB Mac can run the 27B model comfortably without a separate GPU. |
| 64 | +
|
| 65 | +> **Next time:** Just run `./run_caios.sh` from the Project_Andrew folder. |
| 66 | +
|
| 67 | +--- |
| 68 | + |
| 69 | +## Linux (Ubuntu / Debian) |
| 70 | + |
| 71 | +### Step 1 — Install Python 3.11+ |
| 72 | +```bash |
| 73 | +sudo apt update |
| 74 | +sudo apt install python3.12 python3.12-pip python3.12-venv |
| 75 | +``` |
| 76 | +On other distributions (Arch, Fedora, etc.) use the equivalent package manager. |
| 77 | + |
| 78 | +### Step 2 — Run the setup script |
| 79 | +```bash |
| 80 | +cd /path/to/Project_Andrew |
| 81 | +chmod +x run_caios.sh |
| 82 | +./run_caios.sh |
| 83 | +``` |
| 84 | +The script installs Ollama via the official install script, downloads the model, and starts the interface. |
| 85 | + |
| 86 | +When you see **"Web UI: http://localhost:5000"**, open that in your browser. |
| 87 | + |
| 88 | +> **NVIDIA GPU:** Install NVIDIA drivers (525+) and Ollama will use your GPU automatically. No CUDA toolkit needed separately. |
| 89 | +> **AMD GPU:** Supported on Linux via ROCm. Windows AMD GPU acceleration is not yet stable. |
| 90 | +
|
| 91 | +> **Next time:** Just run `./run_caios.sh`. |
| 92 | +
|
| 93 | +--- |
| 94 | + |
| 95 | +## First login |
| 96 | + |
| 97 | +When the browser opens you'll see a sign-in screen: |
| 98 | + |
| 99 | +1. **Username** — enter the name you set during first-time setup (or your first name if you used the personal option) |
| 100 | +2. **Password** — only if you chose to set one during setup; otherwise leave blank |
| 101 | +3. **Select model** — choose the Qwen model from the list (it will already be selected) |
| 102 | +4. Click **Start session** |
| 103 | + |
| 104 | +--- |
| 105 | + |
| 106 | +## What the scripts start automatically |
| 107 | + |
| 108 | +| Service | Purpose | Port | |
| 109 | +|---|---|---| |
| 110 | +| Ollama | Runs the AI model locally | 11434 | |
| 111 | +| CAIOS Bridge | Connects the web UI to Andrew | 5000 | |
| 112 | +| windows-mcp | Windows UI automation (Windows only) | 8000 | |
| 113 | +| MCP filesystem server | Lets Andrew read/write files | 3000 | |
| 114 | + |
| 115 | +All of these run on your local machine. Nothing is sent to external servers unless you configure an API key for OpenAI, Anthropic, or another provider — and that's entirely optional. |
| 116 | + |
| 117 | +--- |
| 118 | + |
| 119 | +## Troubleshooting |
| 120 | + |
| 121 | +**"Ollama not found" after installing** |
| 122 | +Close the terminal and open a new one, then run the script again. The PATH update sometimes requires a fresh terminal. |
| 123 | + |
| 124 | +**Model download stops partway through** |
| 125 | +Just run the script again — Ollama resumes downloads from where they stopped. |
| 126 | + |
| 127 | +**Port already in use error** |
| 128 | +Something else is using port 5000. Edit `caios_bridge.py` and change `port=5000` to `port=5001` near the bottom of the file, then use `http://localhost:5001` instead. |
| 129 | + |
| 130 | +**Session expired after 15 minutes** |
| 131 | +Normal behaviour — the login screen will reappear automatically. Sign in again to continue. The conversation history is preserved. |
| 132 | + |
| 133 | +**"No models found" on the model selection screen** |
| 134 | +Ollama is running but no models are downloaded yet. Open a terminal and run: |
| 135 | +``` |
| 136 | +ollama pull qwen3:27b |
| 137 | +``` |
| 138 | +Then refresh the browser. |
| 139 | + |
| 140 | +--- |
| 141 | + |
| 142 | +## Hardware notes |
| 143 | + |
| 144 | +| RAM | What runs well | |
| 145 | +|---|---| |
| 146 | +| 8 GB | 7B models (faster, less capable) | |
| 147 | +| 16 GB | 14B models (good balance) | |
| 148 | +| 32 GB+ | 27B–32B models (what CAIOS is optimised for) | |
| 149 | + |
| 150 | +| GPU | What runs well | Recomended Min: 3070/3080 Ti, 4070, RX 6800 XT, or the Mac Mini M2 Pro (18–36 GB unified) |
| 151 | +Role | Minimum GPU | Recommended | Model: Best Qwen3 27b or R1 32b with 24GB VRAM/64GB RAM |
| 152 | +Sovereign | 12 GB VRAM | 24 GB | Qwen3 16B or DeepSeek-R1 14B |
| 153 | +Edge node | 6 GB VRAM | 8 GB | Qwen2.5 7B |
| 154 | + |
| 155 | +16B Q4 quantized (what Ollama pulls by default) sits around 9–10 GB VRAM, leaving -2 GB headroom for the KV cache during inference. That's comfortable on a 12 GB card. The full CAIOS system prompt is roughly 28k characters — at 16B that fits within a 16k context window with room for conversation history, which covers the majority of CAIOS.txt without truncation. The sections that get cut at 16k are the tail end of the Appendix material and some of the detailed test suite comments, which are lower-priority than the core CPOL, ARL, and ethics blocks near the top. |
| 156 | +The 27B model gives noticeably better reasoning, especially for the CPOL paradox detection and autonomous specialist deployment. If you're on 8 GB, `qwen2.5:7b` is the recommended fallback — change the pull command in the setup script accordingly. |
| 157 | +8B works for edge nodes doing specialist research or curiosity engine tasks — they're running shorter, domain-focused prompts rather than the full system prompt. Wouldn't recommend it for sovereign because the paradox oscillation reasoning degrades noticeably below 14B and it starts collapsing UNDECIDABLE cases to FALSE rather than holding the oscillation. |
0 commit comments