45.1 Two Multi-Page Workflows

AIUNIFY Chat supports two user-facing ways to bring multiple website pages into an Agent:

  • Sitemap crawling from the Agent's normal Sources page.
  • Site discovery and bulk page selection during the onboarding workflow.

These should not be confused with one another.

45.2 Adding a Sitemap from Sources

On the Agent's Sources page:

  1. Open Add a page.
  2. Expand Advanced.
  3. Change Source type to Sitemap — crawl all URLs in the sitemap.xml.
  4. Enter the sitemap URL.
  5. Select Add sitemap & crawl all.

45.3 Use a Real Sitemap URL

The interface warns users to choose Sitemap only when pasting a real sitemap.xml.

The deployed validation expects a sitemap-like URL, normally one ending in .xml or containing “sitemap” in its path.

For one ordinary webpage, select Single URL instead.

45.4 Sitemap Progress

A Sitemap Source can represent multiple indexed pages. The Sources list can display the number of pages indexed compared with the total known page count.

Use Refresh while background crawling is still in progress.

45.5 Site Discovery During Onboarding

During initial onboarding, AIUNIFY Chat can automatically discover candidate pages from a website.

The discovery process can use sitemap information and common website paths to build a list of candidate URLs.

45.6 Reviewing Discovered Pages

The onboarding interface displays Found [count] pages and tells the user:

Pick the ones you want the agent to learn from. You can add more later.

Each discovered URL has a checkbox so you can control which pages become Knowledge Sources.

45.7 Adding Selected Pages in Bulk

  1. Review the discovered URL list.
  2. Select the pages containing useful visitor-facing information.
  3. Review the selected count.
  4. Select Add [count] & continue.

Each selected URL becomes its own URL Source and is queued for crawling.

45.8 Discovery Is an Onboarding Surface

In the deployed customer interface inspected for this manual, the discovered-page checkbox workflow is exposed during onboarding rather than as a general bulk-discovery button on the normal Sources page.

After onboarding, add more content through the normal Sources page using Single URL, Sitemap, pasted text, or supported file/integration workflows.

45.9 If No Pages Are Found

The onboarding interface can report that no pages were found from the sitemap or common paths. In that situation, continue and add URLs manually from the Agent's Sources page.

45.10 Selection Best Practice

Do not automatically select every discovered page. Prioritize pages containing accurate, current, visitor-relevant information so the Agent's Knowledge remains focused.

Write Your Comment