From time to time you might want to track changes to a website or a section of a website. Digimind agents will check the website pages you specify once a week for any changes and then bring back any modifications for you.
What to do
Inside an agent, click to open the advanced configurations:
Then scroll down the options until you find the website section:
Click to add either a website source (no password or log in is required) or if needs be, select "Add a website with authentification" if you need to identify yourself to acces this site.
This will take you to the website wizard.
Copy paste the URL of the site into the field URL.
The name of the website will be automatically filled for you, but you can edit this if you would like.
Depth: This determines how many layers of pages you would like Digimind to track. The landing page (the URL you specify to Digimind) is considered as level 0. After one click, Digimind arrives on level 1. After a second click, Digimind arrives at level 2, etc.
Number of pages: This indicates how many pages the Digimind agent will open before it stops the crawl.
Domain / Directory: It is possible to limit the crawl to a specific section of the site by clicking on "Directory". In this case, all pages that are in the same section of the site will be tracked, but any pages outside the directory will not be monitored.
Robot: Leave this box checked.
URL pattern: Similar pages on a website, or those from the same section, usually start with the same URL root. Click around on the website to identify the URL root of the pages you would like to monitor. After the root add * so that the agent knows to look for any pages that start with this root.
Type of files: You can specify if you would like only to monitor certain types of file (for example PowerPoint docs or PDFs).
In the page monitoring section, specify the degree of modification that will generate an alert. It is also possible to add a specfic query to this crawl. This will over ride any existing query for that agent for this specific source.
Then click on OK.
You will now see on the advanced configuration page of your agent that the source has been added:
On the right of the page you will see a yellow pencil (click to edit the details of this source) and a red cross (click to remove the source from this agent).
Your Digimind agent will now check this web site for modifications once a week over the weekend.*