# FastChat - Doramagic AI Context Pack > Purpose: pre-work context for the user's host AI. This pack does not prove that the project has been installed, run, or validated. ## Project - canonical_name: `lm-sys/FastChat` - capability: An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. - expected_user_outcome: An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena. ## Operating Boundaries - Do not claim that the project has been installed, run, called through an API, or used on local files unless separate evidence proves it. - Project facts must come from repo evidence, Claim Graph, or explicit source references. - When a capability is not verified, mark it as unverified instead of completing it as fact. - publish_status: `publishable` - blocking_gaps: none --- ## Doramagic Context Augmentation The following sections strengthen the repository context for a host AI. Human Manual data is a reading route, and pitfall notes become operating constraints. ## Human Manual Outline Usage rule: this is only a reading route and salience signal, not factual authority. Concrete claims must still return to repo evidence or Claim Graph. Host AI hard rules: - Do not treat page titles, section order, summaries, or importance values as factual project evidence. - When explaining the Human Manual outline, state that it is only a reading route or salience signal. - Capability, installation, compatibility, runtime state, and risk claims must cite repo evidence, source paths, or Claim Graph. - **Overview and Distributed Serving Architecture**: importance `high` - source_paths: README.md, docs/server_arch.md, fastchat/serve/controller.py, fastchat/serve/register_worker.py, fastchat/serve/cli.py - **Serving: Workers, Web UI, and APIs**: importance `high` - source_paths: fastchat/serve/model_worker.py, fastchat/serve/base_model_worker.py, fastchat/serve/vllm_worker.py, fastchat/serve/sglang_worker.py, fastchat/serve/lightllm_worker.py - **Training Pipeline and Model Support**: importance `high` - source_paths: fastchat/train/train.py, fastchat/train/train_mem.py, fastchat/train/train_lora.py, fastchat/train/train_xformers.py, fastchat/train/train_flant5.py - **Evaluation, Datasets, and Chatbot Arena Monitoring**: importance `high` - source_paths: fastchat/llm_judge/README.md, fastchat/llm_judge/common.py, fastchat/llm_judge/gen_model_answer.py, fastchat/llm_judge/gen_api_answer.py, fastchat/llm_judge/gen_judgment.py ## Repo Inspection Evidence - repo_clone_verified: true - repo_inspection_verified: true - repo_commit: `587d5cfa1609a43d192cedb8441cac3c17db105d` - inspected_files: `pyproject.toml`, `README.md`, `docs/awq.md`, `docs/lightllm_integration.md`, `docs/model_support.md`, `docs/dashinfer_integration.md`, `docs/gptq.md`, `docs/openai_api.md`, `docs/xFasterTransformer.md`, `docs/training.md`, `docs/exllama_v2.md`, `docs/mlx_integration.md`, `docs/arena.md`, `docs/vicuna_weights_version.md`, `docs/server_arch.md`, `docs/dataset_release.md`, `docs/langchain_integration.md`, `docs/third_party_ui.md`, `docs/vllm_integration.md`, `docs/commands/local_cluster.md` Host AI hard rules: - Without repo_clone_verified=true, do not claim that the source code has been read. - Without repo_inspection_verified=true, do not write README, docs, or package-file conclusions as facts. - Without quick_start_verified=true, do not claim that the Quick Start path has run successfully. ## Doramagic Pitfall Constraints These rules come from Doramagic discovery, validation, or compilation findings. The host AI must treat them as operating constraints, not background notes. ### Constraint 1: Maintenance risk requires verification - Trigger: Project evidence flags a maintenance risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/lm-sys/FastChat/issues/1048 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 2: Security or permission risk requires verification - Trigger: Project evidence flags a security or permission risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/lm-sys/FastChat/issues/1711 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 3: Identity risk requires verification - Trigger: Project evidence flags a identity risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: identity.distribution | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 4: Capability evidence risk requires verification - Trigger: README/documentation is current enough for a first validation pass. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: capability.assumptions | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 5: Maintenance risk requires verification - Trigger: Project evidence flags a maintenance risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: evidence.maintainer_signals | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 6: Security or permission risk requires verification - Trigger: no_demo - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: downstream_validation.risk_items | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 7: Security or permission risk requires verification - Trigger: no_demo - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: risks.scoring_risks | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 8: Security or permission risk requires verification - Trigger: Project evidence flags a security or permission risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/lm-sys/FastChat/issues/3886 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 9: Maintenance risk requires verification - Trigger: issue_or_pr_quality=unknown。 - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: evidence.maintainer_signals | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 10: Maintenance risk requires verification - Trigger: release_recency=unknown。 - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: evidence.maintainer_signals | github_repo:615882673 | https://github.com/lm-sys/FastChat - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.