# Scrapling - Doramagic AI Context Pack > Purpose: pre-work context for the user's host AI. This pack does not prove that the project has been installed, run, or validated. ## Project - canonical_name: `D4Vinci/Scrapling` - capability: 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! - expected_user_outcome: 🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! ## Operating Boundaries - Do not claim that the project has been installed, run, called through an API, or used on local files unless separate evidence proves it. - Project facts must come from repo evidence, Claim Graph, or explicit source references. - When a capability is not verified, mark it as unverified instead of completing it as fact. - publish_status: `publishable` - blocking_gaps: none --- ## Doramagic Context Augmentation The following sections strengthen the repository context for a host AI. Human Manual data is a reading route, and pitfall notes become operating constraints. ## Human Manual Outline Usage rule: this is only a reading route and salience signal, not factual authority. Concrete claims must still return to repo evidence or Claim Graph. Host AI hard rules: - Do not treat page titles, section order, summaries, or importance values as factual project evidence. - When explaining the Human Manual outline, state that it is only a reading route or salience signal. - Capability, installation, compatibility, runtime state, and risk claims must cite repo evidence, source paths, or Claim Graph. - **Scrapling Overview and System Architecture**: importance `high` - source_paths: README.md, pyproject.toml, scrapling/__init__.py, scrapling/parser.py, scrapling/core/_types.py - **Fetchers and the Stealth Engine**: importance `high` - source_paths: scrapling/fetchers/__init__.py, scrapling/fetchers/requests.py, scrapling/fetchers/chrome.py, scrapling/fetchers/stealth_chrome.py, scrapling/engines/static.py - **Spider Framework and Crawling Infrastructure**: importance `high` - source_paths: scrapling/spiders/__init__.py, scrapling/spiders/spider.py, scrapling/spiders/engine.py, scrapling/spiders/request.py, scrapling/spiders/session.py - **AI Integration, CLI, Interactive Shell, and Agent Skill**: importance `medium` - source_paths: scrapling/cli.py, scrapling/core/ai.py, scrapling/core/shell.py, scrapling/core/_shell_signatures.py, scrapling/core/translator.py ## Repo Inspection Evidence - repo_clone_verified: true - repo_inspection_verified: true - repo_commit: `c0f012d6625528a756e3852bad9ae7500c223579` - inspected_files: `Dockerfile`, `README.md`, `pyproject.toml`, `docs/README_AR.md`, `docs/README_CN.md`, `docs/README_DE.md`, `docs/README_ES.md`, `docs/README_FR.md`, `docs/README_JP.md`, `docs/README_KR.md`, `docs/README_PT_BR.md`, `docs/README_RU.md`, `docs/ai/mcp-server.md`, `docs/api-reference/custom-types.md`, `docs/api-reference/fetchers.md`, `docs/api-reference/mcp-server.md`, `docs/api-reference/proxy-rotation.md`, `docs/api-reference/response.md`, `docs/api-reference/selector.md`, `docs/api-reference/spiders.md` Host AI hard rules: - Without repo_clone_verified=true, do not claim that the source code has been read. - Without repo_inspection_verified=true, do not write README, docs, or package-file conclusions as facts. - Without quick_start_verified=true, do not claim that the Quick Start path has run successfully. ## Doramagic Pitfall Constraints These rules come from Doramagic discovery, validation, or compilation findings. The host AI must treat them as operating constraints, not background notes. ### Constraint 1: Installation risk requires verification - Trigger: Project evidence flags a installation risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/D4Vinci/Scrapling/issues/294 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 2: Installation risk requires verification - Trigger: Project evidence flags a installation risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/D4Vinci/Scrapling/issues/350 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 3: Installation risk requires verification - Trigger: Project evidence flags a installation risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/D4Vinci/Scrapling/issues/299 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 4: Installation risk requires verification - Trigger: Project evidence flags a installation risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/D4Vinci/Scrapling/issues/348 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 5: Capability evidence risk requires verification - Trigger: README/documentation is current enough for a first validation pass. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: capability.assumptions | https://github.com/D4Vinci/Scrapling - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 6: Runtime risk requires verification - Trigger: Project evidence flags a runtime risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/D4Vinci/Scrapling/issues/349 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 7: Maintenance risk requires verification - Trigger: Project evidence flags a maintenance risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: evidence.maintainer_signals | https://github.com/D4Vinci/Scrapling - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 8: Security or permission risk requires verification - Trigger: no_demo - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: downstream_validation.risk_items | https://github.com/D4Vinci/Scrapling - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 9: Security or permission risk requires verification - Trigger: no_demo - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: risks.scoring_risks | https://github.com/D4Vinci/Scrapling - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it. ### Constraint 10: Security or permission risk requires verification - Trigger: Project evidence flags a security or permission risk. Review the linked source before relying on this workflow. - Host AI rule: Reproduce the official install and quickstart path in an isolated environment. - Why it matters: May increase setup, validation, or first-run risk for the user. - Evidence: community_evidence:github | https://github.com/D4Vinci/Scrapling/issues/295 - Hard boundary: Do not present this pitfall as solved, verified, or ignorable unless later evidence explicitly closes it.