# webintel-mcp - Doramagic AI Context Pack

> Positioning: a pre-install experience and judgment asset. It helps the host AI get off to a good start, but it does not mean the project has already been installed, run, or validated.

## Sufficiency Principle

- **Sufficiency over compression**: The AI Context Pack should be sufficient for the host AI to understand the project's value, capability boundaries, entrypoints, risks, and evidence sources before starting work; it may be layered, but it does not aim for the shortest possible summary.
- **Compression policy**: Compress only noise and duplication, never context that affects judgment or the quality of the work.

## How the Host AI Should Use This

You are reading the AI Context Pack that Doramagic compiled for webintel-mcp. Treat it as pre-work context: help the user understand who it fits, what it can do, how to start, what must be verified after install, and where the risks are. Do not claim that you have already installed, run, or executed the target project.

## Claim Consumption Rules

- **Fact source**: Repo Evidence + Claim/Evidence Graph; the Human Wiki only supplies salience, terminology, and narrative structure.
- **Minimum status for a fact**: `supported`
- `supported`: May be used as a project fact, but the answer must cite the claim_id and evidence path.
- `weak`: Usable only as a low-confidence lead; the user must be asked to keep verifying.
- `inferred`: Usable only for risk notes or open questions; must not be packaged as a project fact.
- `unverified`: Must not be used as fact; state clearly that evidence is insufficient.
- `contradicted`: Must show the conflicting sources and must not force a single version on the user's behalf.

## Who It Fits Best

- **Developers already using host AIs such as Claude/Codex/Cursor/Gemini**: The README or plugin config mentions multiple host AIs. Evidence: `README.md` Claim: `clm_0002` supported 0.86

## What It Can Do

- **Command-Line Startup or Install Flow** (Verify after install): The project documentation contains runnable commands; real use requires running them in a local or host environment. Evidence: `README.md` Claim: `clm_0001` supported 0.86

## How to Start

- `git clone https://github.com/kengbailey/webintel-mcp.git` Evidence: `README.md` Claim: `clm_0003` supported 0.86
- `pip install -r requirements.txt` Evidence: `README.md` Claim: `clm_0004` supported 0.86
- `pip install playwright` Evidence: `README.md` Claim: `clm_0005` supported 0.86

## Continue-or-Stop Decision Card

- **Current recommendation**: Needs admin / security approval
- **Why**: Continuing may involve secrets, accounts, external services, or sensitive context; get admin or security approval first.

### 30-Second Read

- **What to do now**: Needs admin / security approval
- **Minimum safe next step**: Run Prompt Preview first; if credentials or an enterprise environment are involved, get approval before trialing
- **Do not trust yet**: Tool permission boundaries cannot be trusted before install.
- **Continuing will touch**: Command execution, Host AI configuration, Local environment or project files

### What You Can Trust Now

- **Target-audience signal: Developers already using host AIs such as Claude/Codex/Cursor/Gemini** (supported): Backed by a supported claim or project evidence, but that still is not the same as real install results. Evidence: `README.md` Claim: `clm_0002` supported 0.86
- **Capability exists: Command-Line Startup or Install Flow** (supported): You can trust that the project contains signals of this capability; whether it fits your specific task still needs trial or after-install verification. Evidence: `README.md` Claim: `clm_0001` supported 0.86
- **There are Quick Start / install-command signals** (supported): You can trust that the docs mention a startup or install entrypoint; do not run it directly in your primary environment because of that. Evidence: `README.md` Claim: `clm_0003` supported 0.86

### What You Cannot Trust Yet

- **Tool permission boundaries cannot be trusted before install.** (unverified): MCP/tool projects usually touch files, the network, the browser, or external APIs, so permissions and logs must be checked for real.
- **Real output quality cannot be trusted before install.** (unverified): Prompt Preview can only show how it guides you; it cannot prove result quality in the real project.
- **Host AI version compatibility cannot be trusted before install.** (unverified): Host loading rules and version differences across Claude, Cursor, Codex, Gemini, and others must be verified in a real environment.
- **That it will not pollute your existing host AI's behavior cannot be trusted directly.** (inferred): Skill, plugin, and AGENTS/CLAUDE/GEMINI instructions may change the host AI's default behavior. Evidence: `CLAUDE.md`
- **Safe rollback cannot be assumed by default.** (unverified): Unless the project clearly provides uninstall and recovery instructions, verify in an isolated environment first.
- **After a real install, is it compatible with the user's current host AI version?** (unverified): Compatibility can only be verified in the actual host environment.
- **Does the project's output quality meet the user's specific task?** (unverified): The pre-install preview can only show flow and boundaries; it cannot replace real evaluation.
- **Do the install commands require network access, permissions, or global writes?** (unverified): This affects install risk in both enterprise and personal environments. Evidence: `README.md`

### What Continuing Will Touch

- **Command execution**: Package managers, network downloads, the local plugin directory, project config, or the user's home directory. Why: Running the very first command can already change your environment; decide whether it is worth running first. Evidence: `README.md`
- **Host AI configuration**: The plugin, Skill, or rule-loading config of hosts like Claude/Codex/Cursor/Gemini/OpenCode. Why: Host configuration changes how the AI works afterward and may conflict with the user's existing rules. Evidence: `CLAUDE.md`
- **Local environment or project files**: Install results, plugin caches, project config, or local dependency directories. Why: The write scope and rollback path cannot be proven before install and need isolated verification. Evidence: `README.md`
- **Environment variables / API keys**: Project entry docs explicitly showing API key, token, secret, or account credential configuration. Why: If a real install needs credentials, use test credentials first and go through a permission/compliance review. Evidence: `README.md`, `doc/youtube-transcript-implementation.md`, `src/core/config.py`
- **Host AI context**: The AI Context Pack, Prompt Preview, Skill routing, risk rules, and project facts. Why: Importing context affects the host AI's later judgment, so avoid packaging unverified items as facts.

### Minimum Safe Next Steps

- **Run Prompt Preview first**: Use a pre-install interactive trial to judge whether the way of working fits; it needs no authorization or environment change. (applies when: Applies to any project, especially when output quality is unknown.)
- **Trial-install only in an isolated directory or a test account**: Avoid letting install commands pollute your primary host AI, real projects, or home directory. (applies when: When there are signals of command execution, plugin config, or local writes.)
- **Back up your host AI configuration first**: Skill, plugin, and rule files may change the default behavior of Claude/Cursor/Codex. (applies when: When there is a plugin manifest, a Skill, or a host rule entrypoint.)
- **Do not use real production credentials**: Once an environment variable / API key enters the host or toolchain, it can create account and compliance risk. (applies when: When environment signals like API, TOKEN, KEY, or SECRET appear.)
- **After install, verify just one minimal task**: Verify loading, compatibility, output quality, and rollback first, then decide whether to use it deeply. (applies when: When moving from a trial into a real workflow.)

### Exit Plan

- **Preserve the pre-install state**: Record the original host config and project state so you can later judge whether it is recoverable.
- **Be ready to remove the host plugin / Skill / rule entrypoint**: If behavior is off after the trial install, you can restore the host AI to its pre-trial state.
- **Record the install commands and written paths**: Without clear uninstall instructions, you at least need to know which directories or configs to clean up manually.
- **Be ready to revoke test API keys or tokens**: If test credentials leak or are misused, you can cut losses quickly.
- **If there is no rollback path, do not enter your primary environment**: No rollback is a blocker before continuing; do not proceed on trust or luck.

## What Can Only Be Previewed

- Explain who the project fits and what it can do
- Demonstrate a typical conversation flow based on project docs
- Help the user decide whether it is worth installing or researching further

## What Must Be Verified After Install

- Actually installing the Skill, plugin, or CLI
- Running scripts, modifying local files, or accessing external services
- Verifying real output quality, performance, and compatibility

## Boundary & Risk Decision Card

- **Mistaking the pre-install preview for a real run**: The user may overestimate how much configuration, permission, and compatibility verification the project has already done. Mitigation: Clearly separate prompt_preview_can_do from runtime_required. Claim: `clm_0006` inferred 0.45
- **Command execution will modify the local environment**: Install commands may write to the user's home directory, the host plugin directory, or project configuration. Mitigation: Run in an isolated environment or a test account first. Evidence: `README.md` Claim: `clm_0007` supported 0.86
- **To confirm**: After a real install, is it compatible with the user's current host AI version?. Why: Compatibility can only be verified in the actual host environment.
- **To confirm**: Does the project's output quality meet the user's specific task?. Why: The pre-install preview can only show flow and boundaries; it cannot replace real evaluation.
- **To confirm**: Do the install commands require network access, permissions, or global writes?. Why: This affects install risk in both enterprise and personal environments.

## Pre-Work Working Context

### Loading Order

- First read how_to_use.host_ai_instruction to establish the boundaries of this pre-install judgment asset.
- Read claim_graph_summary to confirm facts come from the Claim/Evidence Graph, not the Human Wiki narrative.
- Then read intended_users, capabilities, and quick_start_candidates to judge whether the user is a match.
- When you need to carry out a concrete task, check role_skill_index first, then evidence_index.
- For real install, file modification, network access, performance, or compatibility questions, turn to risk_card and boundaries.runtime_required.

### Task Routes

- **Command-Line Startup or Install Flow**: State that this is an after-install capability first, then give a pre-install checklist. Boundary: Must be verified after a real install or run. Evidence: `README.md` Claim: `clm_0001` supported 0.86

### Context Scale

- Total files: 33
- Important-file coverage: 30/33
- Evidence index entries: 27
- Role / Skill entries: 8

### Handling Insufficient Evidence

- **missing_evidence**: State that evidence is insufficient and ask the user for the target file, a README section, or after-install verification records; do not fill in facts.
- **out_of_scope_request**: State that the task is beyond the current AI Context Pack's evidence scope and suggest the user check the Human Manual or verify after a real install.
- **runtime_request**: Provide a pre-install checklist and command sources, but do not run commands for the user or claim they have been run.
- **source_conflict**: Show the conflicting sources side by side, mark them as unverified, and do not force a single version.

## Prompt Recipes

### Fit assessment

- Goal: Judge whether this project fits the user's current task.
- Expected output: A fit conclusion, key reasons, evidence citations, what can be previewed before install, what must be verified after install, and a next-step recommendation.

```text
Based on the AI Context Pack for webintel-mcp, ask me 3 necessary questions first, then judge whether it fits my task. The answer must cover: who it fits, what it can do, what it cannot do, whether it is worth installing, and where the evidence comes from. Every project fact must cite evidence_refs, source_paths, or a claim_id.
```

### Pre-install experience

- Goal: Let the user feel the core workflow before installing, while avoiding packaging the preview as real capability or a marketing promise.
- Expected output: An experience script with boundary labels, an after-install verification checklist, and a cautious recommendation; with no real-run promises or strong marketing language.

```text
Treat webintel-mcp as a pre-install experience asset, not an already-installed tool or a real runtime environment.

Output exactly four parts:
1. Ask me 3 necessary questions first.
2. Give an "experience script": use the three labels [Previewable before install], [Must verify after install], and [Insufficient evidence] to show how it might guide the workflow.
3. Give an after-install verification checklist: list which capabilities can only be confirmed after a real install, real host loading, and a real project run.
4. Give a cautious recommendation: only "worth researching/trialing further", "add information before deciding", or "not recommended to continue"; do not endorse the project.

Hard boundaries:
- Do not claim you have installed, run, executed tests, modified files, or produced real results.
- Do not write promise-like phrasing such as "auto-adapts", "guarantees passing", "perfect fit", or "strongly recommend installing".
- If you describe how it works after install, you must use a conditional such as "if installed successfully and the host loads the Skill correctly, it might...".
- The experience script may only be written as "example lines / hypothetical flow": use "might ask / might suggest / might show", not "has written, has generated, has passed, is running, is generating".
- Prompt Preview does not hand out install commands; if the user is ready to trial, only prompt them to read Quick Start and the Risk Card first and to verify in an isolated environment.
- Every project fact must come from a supported claim, evidence_refs, or source_paths; inferred/unverified items can only be risks or open questions.

```

### Role / Skill selection

- Goal: Pick the best-matching asset from the project's roles or Skills.
- Expected output: A list of candidate roles or Skills, each with an applicable scenario, evidence paths, risk boundary, and whether after-install verification is needed.

```text
Read role_skill_index and recommend 3-5 of the most relevant roles or Skills for my target task. For each recommendation, state the applicable scenario, likely output, risk boundary, and evidence_refs.
```

### Risk pre-check

- Goal: Identify environment, permission, rule-conflict, and quality risks before installing or adopting.
- Expected output: A checklist of environment, permission, dependency, license, host-conflict, quality risk, and unknown items.

```text
Based on risk_card, boundaries, and quick_start_candidates, give me a pre-install risk pre-check list. Do not run commands for me; only explain what I should check, why, and what impact a failure would have.
```

### Host AI kickoff instruction

- Goal: Turn the project context into a host AI instruction for the start of a conversation.
- Expected output: A pre-work instruction with clear boundaries and clear evidence citations, suitable to copy to a host AI.

```text
Based on the AI Context Pack for webintel-mcp, generate a pre-work instruction I can paste to my host AI. This instruction must obey not_runtime=true and must not claim the project has been installed, run, or produced real results.
```

## Role / Skill Index

- Indexed 8 role / Skill / project-doc entries.

- **WebIntel MCP** (project_doc): ! License: MIT https://img.shields.io/badge/License-MIT-blue.svg LICENSE ! Python 3.11+ https://img.shields.io/badge/python-3.11+-green.svg https://www.python.org ! FastMCP https://img.shields.io/badge/FastMCP-3.0-purple.svg https://github.com/jlowin/fastmcp Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `README.md`
- **SearxNG Configuration** (project_doc): This directory contains the default configuration for the bundled SearxNG instance. Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `searxng/README.md`
- **CLAUDE.md - Project Guidelines for AI Agents** (project_doc): CLAUDE.md - Project Guidelines for AI Agents Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `CLAUDE.md`
- **Advanced: External SearxNG Setup** (project_doc): Note: WebIntel MCP now includes a bundled SearxNG instance. You only need this guide if you want to run SearxNG as a separate, standalone service. For the standard setup, just run docker compose up -d — see the main README /README.md . Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `doc/setup-searxng-and-mcp-server.md`
- **Pagination Implementation Summary** (project_doc): Overview Added pagination support to the fetch content tool using an offset-based approach, allowing retrieval of content that exceeds the 30,000 character limit. Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `doc/PAGINATION_IMPLEMENTATION.md`
- **Fetch Content Pagination Example** (project_doc): This document demonstrates how to use the fetch content tool with pagination support. Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `doc/pagination-example.md`
- **YouTube Content Fetcher Bug Fix** (project_doc): Issue The fetch youtube content tool was failing with error: "The downloaded file is empty" Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `doc/youtube-bugfix-summary.md`
- **YouTube Transcript Implementation** (project_doc): Overview Added fetch youtube content tool to transcribe YouTube videos using yt-dlp and a Speech-to-Text STT service. Activation hint: Reference this when the user needs to understand the project's structure, install path, or boundaries. Evidence: `doc/youtube-transcript-implementation.md`

## Evidence Index

- Indexed 27 evidence entries.

- **WebIntel MCP** (documentation): ! License: MIT https://img.shields.io/badge/License-MIT-blue.svg LICENSE ! Python 3.11+ https://img.shields.io/badge/python-3.11+-green.svg https://www.python.org ! FastMCP https://img.shields.io/badge/FastMCP-3.0-purple.svg https://github.com/jlowin/fastmcp Evidence: `README.md`
- **SearxNG Configuration** (documentation): This directory contains the default configuration for the bundled SearxNG instance. Evidence: `searxng/README.md`
- **CLAUDE.md - Project Guidelines for AI Agents** (documentation): CLAUDE.md - Project Guidelines for AI Agents Evidence: `CLAUDE.md`
- **License** (source_file): Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files the "Software" , to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: Evidence: `LICENSE`
- **Advanced: External SearxNG Setup** (documentation): Note: WebIntel MCP now includes a bundled SearxNG instance. You only need this guide if you want to run SearxNG as a separate, standalone service. For the standard setup, just run docker compose up -d — see the main README /README.md . Evidence: `doc/setup-searxng-and-mcp-server.md`
- **===========================================** (source_file): =========================================== WebIntel MCP Configuration =========================================== Evidence: `.env.example`
- **Searxng Compose** (source_file): services: searxng: container name: searxng image: docker.io/searxng/searxng:latest restart: unless-stopped ports: - "8189:8080" volumes: - /home/syran/sandbox/docker/appdata/searxng:/etc/searxng:rw Evidence: `doc/searxng-compose.yml`
- **Webintel Mcp Compose** (source_file): services: webintel-mcp: image: ghcr.io/kengbailey/webintel-mcp:latest container name: webintel-mcp ports: - "3090:3090" environment: - SEARXNG HOST=http://localhost:8189 restart: unless-stopped Evidence: `doc/webintel-mcp-compose.yaml`
- **Docker Compose** (source_file): services: searxng: image: docker.io/searxng/searxng:latest container name: searxng volumes: - ./searxng:/etc/searxng:rw restart: unless-stopped healthcheck: test: "CMD", "wget", "--spider", "-q", "http://localhost:8080/healthz" interval: 10s timeout: 5s retries: 3 start period: 10s gluetun: profiles: "vpn" image: qmcgaw/gluetun container name: gluetun cap add: - NET ADMIN devices: - /dev/net/tun:/dev/net/tun environment: - VPN SERVICE PROVIDER - VPN TYPE - OPENVPN CUSTOM CONFIG=/gluetun/custom/config.ovpn - OPENVPN USER - OPENVPN PASSWORD - HTTPPROXY=on volumes: - ./gluetun:/gluetun ports: - "8888:8888" - "8080:8080" restart: unless-stopped searxng-vpn: profiles: "vpn" image: docker.io/sear… Evidence: `docker-compose.yml`
- **Core dependencies** (source_file): Core dependencies fastmcp =3.0.0b1 pydantic =2.0.0 trafilatura =2.0.0 openai =1.0.0 httpx =0.25.0 requests =2.31.0 Evidence: `requirements.txt`
- **Config** (source_file): class SearchConfig ⋮---- SEARXNG HOST = os.getenv 'SEARXNG HOST' ⋮---- REQUEST TIMEOUT = 10 ⋮---- MAX GENERAL RESULTS = 25 MAX VIDEO RESULTS = 20 MAX SUMMARY RESULTS = 15 ⋮---- DEFAULT GENERAL RESULTS = 15 DEFAULT VIDEO RESULTS = 10 DEFAULT SUMMARY RESULTS = 5 ⋮---- MAX CONTENT LENGTH = 30000 FETCH TIMEOUT = 30.0 RENDER TIMEOUT = 30.0 USER AGENT = "Mozilla/5.0 Windows NT 10.0; Win64; x64 AppleWebKit/537.36 KHTML, like Gecko Chrome/91.0.4472.124 Safari/537.36" ⋮---- STT ENDPOINT = os.getenv 'STT ENDPOINT' STT MODEL = os.getenv 'STT MODEL' STT API KEY = os.getenv 'STT API KEY' ⋮---- PROXY URL = os.getenv 'PROXY URL' or None ⋮---- REDDIT CLIENT ID = os.getenv 'REDDIT CLIENT ID' REDDIT CLIENT S… Evidence: `src/core/config.py`
- **Models** (source_file): class GeneralSearchResult BaseModel ⋮---- title: str url: str content: Optional str = None score: Optional float = None category: Optional str = None author: Optional str = None ⋮---- class VideoSearchResult BaseModel ⋮---- published date: Optional str = None duration: Optional Union str, float = None ⋮---- thumbnail: Optional str = None ⋮---- class SearchResultOutput BaseModel ⋮---- score: float ⋮---- class VideoSearchResultOutput BaseModel ⋮---- length: Optional Union str, float = None ⋮---- class FetchContentOutput BaseModel ⋮---- content: str content length: int is truncated: bool offset: int next offset: Optional int = None total length: int success: bool ⋮---- class YouTubeContentOutp… Evidence: `src/core/models.py`
- **Use length or duration, whichever is available** (source_file): class SearxngClient ⋮---- def init self, host: str = None ⋮---- url = f"{self.host}/search" params = {'q': query, 'format': 'json'} ⋮---- response = requests.get ⋮---- data = response.json ⋮---- """ Perform a general web search and return cleaned results. Args: query: The search query max results: Maximum number of results to return categories: Search categories e.g., 'general', 'news', 'science' time range: Time filter 'day', 'month', 'year' language: Language code filter e.g., 'en', 'de' Returns: List of GeneralSearchResult objects """ ⋮---- max results = SearchConfig.DEFAULT GENERAL RESULTS ⋮---- max results = SearchConfig.MAX GENERAL RESULTS ⋮---- raw response = self. search raw ⋮---- r… Evidence: `src/core/search.py`
- **Primary extraction: trafilatura with Markdown output** (source_file): class WebContentFetcher ⋮---- playwright = None browser = None ⋮---- def init self ⋮---- def is pdf url self, url: str - bool ⋮---- url lower = url.lower ⋮---- def is pdf content self, content type: str, content start: bytes - bool ⋮---- @staticmethod def clean browser html html: str - str ⋮---- cleaner = Cleaner doc = fromstring html cleaned = cleaner.clean html doc ⋮---- async def launch browser self ⋮---- async def ensure browser self ⋮---- async def render with browser self, url: str - str ⋮---- browser = await self. ensure browser ⋮---- page = await browser.new page ⋮---- browser = await self. launch browser ⋮---- timeout ms = int SearchConfig.RENDER TIMEOUT 1000 ⋮---- html = await pag… Evidence: `src/core/web_fetcher.py`
- **Validate categories** (source_file): class SearchHandlers ⋮---- def init self ⋮---- max results = SearchConfig.MAX GENERAL RESULTS ⋮---- max results = 1 ⋮---- valid time ranges = 'day', 'month', 'year' ⋮---- Validate categories valid categories = 'general', 'news', 'science', 'it', 'music', 'images', 'videos', 'files', 'social media', 'map' ⋮---- cat = cat.strip ⋮---- Call the search function results = self.client.search general ⋮---- Convert to output models ⋮---- def search videos self, query: str, max results: int = 10 - List VideoSearchResultOutput ⋮---- """ Search for YouTube videos using SearxNG. Args: query: The search query to execute max results: Maximum number of results to return default: 10, max: 20 Returns: List o… Evidence: `src/server/handlers.py`
- **Mcp Server** (source_file): mcp = FastMCP "WebIntel MCP" handlers = SearchHandlers ⋮---- def resolve transport cli http=False, cli sse=False, env transport=None ⋮---- transport = env transport or "http" .lower ⋮---- def resolve port cli port=None, env port=None, default=3090 ⋮---- """Resolve port from CLI argument and environment variable. Returns: int: resolved port number """ ⋮---- def run server ⋮---- """Run the MCP server with appropriate transport and configurable port. Transport priority: 1. CLI flags --http or --sse 2. Environment variable MCP TRANSPORT=http sse 3. Default: http """ parser = argparse.ArgumentParser description="Run MCP server with configurable transport and port" ⋮---- args = parser.parse args Evidence: `src/server/mcp_server.py`
- **Pagination Implementation Summary** (documentation): Overview Added pagination support to the fetch content tool using an offset-based approach, allowing retrieval of content that exceeds the 30,000 character limit. Evidence: `doc/PAGINATION_IMPLEMENTATION.md`
- **Fetch Content Pagination Example** (documentation): This document demonstrates how to use the fetch content tool with pagination support. Evidence: `doc/pagination-example.md`
- **YouTube Content Fetcher Bug Fix** (documentation): Issue The fetch youtube content tool was failing with error: "The downloaded file is empty" Evidence: `doc/youtube-bugfix-summary.md`
- **YouTube Transcript Implementation** (documentation): Overview Added fetch youtube content tool to transcribe YouTube videos using yt-dlp and a Speech-to-Text STT service. Evidence: `doc/youtube-transcript-implementation.md`
- **Git and version control** (source_file): Git and version control .git .gitignore .gitattributes Evidence: `.dockerignore`
- **Auto detect text files and perform LF normalization** (source_file): Auto detect text files and perform LF normalization text=auto Evidence: `.gitattributes`
- **Python cache files** (source_file): Python cache files pycache / .py cod $py.class Evidence: `.gitignore`
- **Use Python 3.11 slim image for smaller size** (source_file): Use Python 3.11 slim image for smaller size FROM python:3.11-slim Evidence: `Dockerfile`
- **Settings** (source_file): use default settings: true server: bind address: "0.0.0.0" secret key: "mySECRETkey" port: 8080 search: safe search: 0 formats: - html - json engines: - name: google engine: google shortcut: g - name: duckduckgo engine: duckduckgo shortcut: d - name: bing engine: bing shortcut: b server.limiter: false Evidence: `doc/settings.yml`
- **Pytest** (source_file): pytest markers = integration: marks tests as integration tests deselect with '-m "not integration"' slow: marks tests as slow deselect with '-m "not slow"' Evidence: `pytest.ini`
- **Settings** (source_file): use default settings: true server: bind address: "0.0.0.0" secret key: "change-me-to-a-random-string" port: 8080 limiter: false search: safe search: 0 formats: - html - json engines: - name: google engine: google shortcut: g - name: duckduckgo engine: duckduckgo shortcut: d - name: bing engine: bing shortcut: b Evidence: `searxng/settings.yml`

## Rules the Host AI Must Follow

- **Treat this asset as pre-work context, not a runtime environment.**: The AI Context Pack contains only an evidence-backed understanding of the project, not the project's executable state. Evidence: `README.md`, `searxng/README.md`, `CLAUDE.md`
- **When answering the user, distinguish what can be previewed from what can only be verified after install.**: The consumer value of the pre-install experience comes from reducing bad installs and misjudgments, not from pretending to be a real run. Evidence: `README.md`, `searxng/README.md`, `CLAUDE.md`

## Questions the User Should Answer First

- Which host AI or local environment do you plan to use it in?
- Do you just want to experience the workflow first, or are you ready to actually install?
- What matters most to you: install cost, output quality, or conflicts with your existing rules?

## Acceptance Checks

- Every capability claim can be traced back to a file path in evidence_refs.
- AI_CONTEXT_PACK.md does not package previews as a real run.
- The user can understand who it fits, what it can do, how to start, and the risk boundaries within 3 minutes.

---

## Doramagic Context Augmentation

The following sections strengthen the repository context for a host AI. Human Manual data is a reading route, and pitfall notes become operating constraints.

## Human Manual Outline

Usage rule: this is only a reading route and salience signal, not factual authority. Concrete claims must still return to repo evidence or Claim Graph.

Host AI hard rules:
- Do not treat page titles, section order, summaries, or importance values as factual project evidence.
- When explaining the Human Manual outline, state that it is only a reading route or salience signal.
- Capability, installation, compatibility, runtime state, and risk claims must cite repo evidence, source paths, or Claim Graph.

- **Introduction to WebIntel MCP**: importance `high`
  - source_paths: README.md, LICENSE, requirements.txt
- **MCP Tools Reference**: importance `high`
  - source_paths: src/server/mcp_server.py, src/server/handlers.py, src/core/models.py
- **Internal Architecture and Core Modules**: importance `high`
  - source_paths: src/server/mcp_server.py, src/server/handlers.py, src/core/config.py, src/core/models.py, src/core/search.py
- **Deployment, Docker, and Configuration**: importance `high`
  - source_paths: Dockerfile, docker-compose.yml, .env.example, doc/setup-searxng-and-mcp-server.md, doc/webintel-mcp-compose.yaml

## Repo Inspection Evidence

- repo_clone_verified: true
- repo_inspection_verified: true
- repo_commit: `750d48848467839d58108898633c3831bc2a2e1e`
- inspected_files: `Dockerfile`, `README.md`, `docker-compose.yml`, `requirements.txt`, `src/__init__.py`, `src/core/__init__.py`, `src/core/config.py`, `src/core/models.py`, `src/core/reddit_fetcher.py`, `src/core/search.py`, `src/core/web_fetcher.py`, `src/core/youtube_fetcher.py`, `src/server/__init__.py`, `src/server/handlers.py`, `src/server/mcp_server.py`

Host AI hard rules:
- Without repo_clone_verified=true, do not claim that the source code has been read.
- Without repo_inspection_verified=true, do not write README, docs, or package-file conclusions as facts.
- Without quick_start_verified=true, do not claim that the Quick Start path has run successfully.

## Doramagic Pitfall Constraints

These rules come from Doramagic discovery, validation, or compilation findings. The host AI must treat them as operating constraints, not background notes.

### Constraint 1: Capability evidence risk requires verification

- Trigger: README/documentation is current enough for a first validation pass.
- Host AI rule: Reproduce the official install and quickstart path in an isolated environment.
- Why it matters: May increase setup, validation, or first-run risk for the user.
- Evidence: capability.assumptions | https://github.com/kengbailey/webintel-mcp
- Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.

### Constraint 2: Security or permission risk requires verification

- Trigger: no_demo
- Host AI rule: Reproduce the official install and quickstart path in an isolated environment.
- Why it matters: May increase setup, validation, or first-run risk for the user.
- Evidence: downstream_validation.risk_items | https://github.com/kengbailey/webintel-mcp
- Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.

### Constraint 3: Security or permission risk requires verification

- Trigger: no_demo
- Host AI rule: Reproduce the official install and quickstart path in an isolated environment.
- Why it matters: May increase setup, validation, or first-run risk for the user.
- Evidence: risks.scoring_risks | https://github.com/kengbailey/webintel-mcp
- Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.

### Constraint 4: Maintenance risk requires verification

- Trigger: issue_or_pr_quality=unknown。
- Host AI rule: Reproduce the official install and quickstart path in an isolated environment.
- Why it matters: May increase setup, validation, or first-run risk for the user.
- Evidence: evidence.maintainer_signals | https://github.com/kengbailey/webintel-mcp
- Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.

### Constraint 5: Maintenance risk requires verification

- Trigger: release_recency=unknown。
- Host AI rule: Reproduce the official install and quickstart path in an isolated environment.
- Why it matters: May increase setup, validation, or first-run risk for the user.
- Evidence: evidence.maintainer_signals | https://github.com/kengbailey/webintel-mcp
- Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.