# Ignore URLs from your site
To make sure that your Chatbot does store old links, we would recommend that you **ignore URLs that you do not want the chatbot to index**.
> đź’ˇ The difference between ignoring URLs and deleting URLs is that the former will completely exclude those URLs from ever being crawled. This means that if you choose to reindex your chatbot, ignored URLs will not be crawled.
Deleting urls is a one off deletion, and deleted URLs are removed from your chatbot. However, in the event of a re-crawl, webpages that were previously deleted would still reappear.
***
### How to ignore URLs from your site
1. Click on “Create Bot” or “Edit Chatbot”
To ignore a single page url, copy and paste the url of the specific page you wish to ignore.
In the example above, the one page url https://wonderchat.com/blogs will be ignored
To ignore an entire subdirectory of pages such as you will need to add an asterisk (\*) behind the url name.
In the example above, the entire subdirectory https://wonderchat.com/blogs will be ignored.
Once the link is ignored, it will not be recrawled for your monthly chatbot recrawl or if you press the recrawl button.
---
# Agent Instructions: Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.
Perform an HTTP GET request on the current page URL with the `ask` query parameter:
```
GET https://docs.wonderchat.io/setup-guides/setting-up-your-chatbot/ignore-urls-from-your-site.md?ask=
```
The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.
Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.