> ## Documentation Index
> Fetch the complete documentation index at: https://docs.irisagent.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Public Websites

> IrisAgent can scrape your public websites for AI training

IrisAgent provides a specialized web scraper designed for extracting data from public websites. It allows you to ingest documentation, tutorials, blogs, and other web content into IrisAgent.

## Upload Custom Content

1. Go to **Configure** page under IrisGPT on the IrisAgent dashboard.
2. Go to the section **"Add content from a website for AI training"**.
3. Add the top-level URL to your website. This page and all the sub-pages will be added.