Data Analysis & Investment Research · Public

FinRL

FinRL®: Financial Reinforcement Learning. 🔥

Best fitUsers who want source-backed project understanding before installing it.

Check whether this project matches your task before installing it.

What it can doskill, recipe, host_instruction, eval, preflight

Review the portable capability path.

Before continuingVerify in a sandbox

Do not treat a preview pack as a proven local install.

GitHub snapshot15k stars

3.4k forks · 129 contributors

Doramagic.ai Last verification date: 2026-06-17 Verification method: source evidence, semantic profile, public page gate, and static build acceptance.

Official first step Read manual preview Source repository

Publication status · 2026-06-17

What is FinRL?

FinRL®: Financial Reinforcement Learning. 🔥
Best fit: Users who want source-backed project understanding before installing it.
Not for: Not for users who want to skip sandbox verification or cannot accept configuration, permission, or maintenance overhead.
Capability added to an AI workflow: skill, recipe, host_instruction, eval, preflight
First safe verification step: Verify the smallest path in an isolated environment and keep a rollback path.
Verification state: source, Quick Start, and sandbox install checks are recorded as passed.
Top risk: May increase setup, validation, or first-run risk for the user.
Evidence base: https://github.com/AI4Finance-Foundation/FinRL, https://github.com/AI4Finance-Foundation/FinRL#readme, Human Manual, Pitfall Log

Quick decision

Use this section to decide whether the project is worth a deeper read.

Best forUsers who want source-backed project understanding before installing it.

Match the project to your task before installing it.

Capabilityskill, recipe, host_instruction, eval, preflight

FinRL®: Financial Reinforcement Learning. 🔥

RepositoryAI4Finance-Foundation/FinRL

15k stars · 3.4k forks

What it can do

Translate the upstream project into concrete capabilities the user can judge before installing.

FinRL Architecture, Three-Layer Framework & Project Layout

Related topics: Market Environments: StockTradingEnv, Crypto, Portfolio & Variants, DRL Agents: Stable Baselines 3, ElegantRL, RLlib & Common Training Errors, Data Pipeline, Paper Trading ...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

Market Environments: StockTradingEnv, Crypto, Portfolio & Variants

Related topics: FinRL Architecture, Three-Layer Framework & Project Layout, DRL Agents: Stable Baselines 3, ElegantRL, RLlib & Common Training Errors, Data Pipeline, Paper Trading (Alpaca)...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

DRL Agents: Stable Baselines 3, ElegantRL, RLlib & Common Training Errors

Related topics: FinRL Architecture, Three-Layer Framework & Project Layout, Market Environments: StockTradingEnv, Crypto, Portfolio & Variants, Data Pipeline, Paper Trading (Alpaca) & End-...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

Data Pipeline, Paper Trading (Alpaca) & End-to-End Applications

Related topics: FinRL Architecture, Three-Layer Framework & Project Layout, Market Environments: StockTradingEnv, Crypto, Portfolio & Variants, DRL Agents: Stable Baselines 3, ElegantRL, R...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

Doramagic Pitfall Log

Source-linked risks stay visible on the manual page so the preview does not read like a recommendation.

Source: Doramagic discovery, validation, and Project Pack records

Sources: https://github.com/AI4Finance-Foundation/FinRL, Human Manual, Project Pack evidence, and downstream validation signals.

Community Discussion Evidence

Project-level external discussion stays visible on the detail page, not only inside the manual.

Stars15k stars

Forks3.4k forks

Contributors129 contributors

Licenseunknown

Community Discussion Evidence

11 source-linked items

Review these external discussions before using FinRL with real data or production workflows. They are review inputs, not standalone proof that the project is production-ready.

01
Google colab Stock_NeurIPS2018_SB3.ipynb StockTradingEnv.reset() got an
github / github_issue
02
DDPG / off-policy algorithms fail due to rollout_buffer logging in FinRL
github / github_issue
03
Question About Open-Sourcing the FinRL-DT Implementation
github / github_issue
04
Feature: Chart pattern similarity as observation/state for RL agents
github / github_issue
05
paper_trading/alpaca.py: submitOrder response list never read after thre
github / github_issue
06
Add pre-trade market state verification to StockTradingEnv
github / github_issue
07
Fix thread target invocation in paper_trading/alpaca.py (submitOrder cal
github / github_issue
08
Is there a way to prevent the FinRL model from doing any Short selling
github / github_issue
09
AttributeError when running "python main.py --mode=train" command
github / github_issue
10
v0.3.8
github / github_release
11
Security or permission risk requires verification
GitHub / issue

How to start

Only source-backed commands are shown here. Verify them in an isolated environment first.

Try the prompt first

Test the workflow without installing the upstream project.

preview

Read the Human Manual

Understand inputs, outputs, limits, and failure modes.

manual

Take context to your AI host

Use the compiled assets in your preferred AI environment.

context

Run sandbox verification

Confirm install commands and rollback before using a primary environment.

verify

pip install finrl

Official start command · https://github.com/AI4Finance-Foundation/FinRL#readme · verified: yes

Human Manual

The English page must expose the real manual, not a short placeholder.

8+ sections · Human Manual

FinRL Manual

FinRL is the original open-source deep reinforcement learning (DRL) framework for finance, positioned as the classic end-to-end research and educational library within the broader AI4Finan...

Open the full manual

https://github.com/AI4Finance-Foundation/FinRL Project Manual
Table of Contents
FinRL Architecture, Three-Layer Framework & Project Layout
Related Pages
Overview & Ecosystem Position
Three-Layer Architecture
Applications Layer
Agents Layer

FinRL Architecture, Three-Layer Framework & Project Layout

Related topics: Market Environments: StockTradingEnv, Crypto, Portfolio & Variants, DRL Agents: Stable Baselines 3, ElegantRL, RLlib & Common Training Errors, Data Pipeline, Paper Trading ...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

Market Environments: StockTradingEnv, Crypto, Portfolio & Variants

Related topics: FinRL Architecture, Three-Layer Framework & Project Layout, DRL Agents: Stable Baselines 3, ElegantRL, RLlib & Common Training Errors, Data Pipeline, Paper Trading (Alpaca)...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

DRL Agents: Stable Baselines 3, ElegantRL, RLlib & Common Training Errors

Related topics: FinRL Architecture, Three-Layer Framework & Project Layout, Market Environments: StockTradingEnv, Crypto, Portfolio & Variants, Data Pipeline, Paper Trading (Alpaca) & End-...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

Data Pipeline, Paper Trading (Alpaca) & End-to-End Applications

Related topics: FinRL Architecture, Three-Layer Framework & Project Layout, Market Environments: StockTradingEnv, Crypto, Portfolio & Variants, DRL Agents: Stable Baselines 3, ElegantRL, R...

Source: https://github.com/AI4Finance-Foundation/FinRL / Human Manual

Doramagic Pitfall Log

Source-linked risks stay visible on the manual page so the preview does not read like a recommendation.

Source: Doramagic discovery, validation, and Project Pack records

AI Context Pack and portable assets

After deciding to continue, take the project context into your own AI host.

Complete pack plus user-owned assets

These files are planning and verification assets for Claude Code, Codex, Gemini, Cursor, ChatGPT, and other AI hosts.

Download complete pack Read Human Manual

BundleComplete Project Pack AssetAI Context Pack AssetBoundary & Risk Card AssetHuman Manual AssetPitfall Log AssetPrompt Preview AssetQuick Start EvidenceREPO_INSPECTION.json

Preflight checks

Treat this page as a planning asset, not proof that your local environment is ready.

The manual is generated from source-linked project files and Doramagic validation signals.
Community evidence warnings stay visible instead of being converted into marketing claims.
This English page is indexable because the locale quality gate passed and explicit English index approval is enabled.
Use the upstream repository as the final authority for installation commands, license, and version-specific behavior.

Pitfall Log and verification risks

Doramagic surfaces high-risk items before users treat a candidate capability as verified.

high

Runtime risk requires verification

May increase setup, validation, or first-run risk for the user.

high

Runtime risk requires verification

May increase setup, validation, or first-run risk for the user.

high

Security or permission risk requires verification

May increase setup, validation, or first-run risk for the user.

high

Security or permission risk requires verification

May increase setup, validation, or first-run risk for the user.

high

Security or permission risk requires verification

May increase setup, validation, or first-run risk for the user.

high

Security or permission risk requires verification

May increase setup, validation, or first-run risk for the user.

medium

Capability evidence risk requires verification

May increase setup, validation, or first-run risk for the user.

medium

Maintenance risk requires verification

May increase setup, validation, or first-run risk for the user.