AI Change Summary
Available in the Enterprise Plan and the Flexi Plan.
Table of Contents
- Why Use Change Summary
- Steps to Enable AI Summary
- Where to View the AI Change Summary?
- Customizing Change Summary
- Extracting Custom Fields
- Prompt Examples
- When Do Monitors Record AI Summaries?
AI Change Summary provides concise summaries of website changes.
Why Use Change Summary
- Provides you quick access to important changes without the need to navigate through the change history or explore Diff.
- Useful if you are monitoring full-page or large-section changes with a high volume of updates.
- You can use Distill’s API to get summary data and integrate into other apps.
- Allows you to add and describe custom fields to capture specific data for inclusion in the AI summary.
Steps to enable AI summary:
- In your watchlist, click the hamburger icon.
- Select
AI Summary
from the list to open the AI Summary Settings.
- Toggle the
Summarize Changes
to “On”.
Where to view the AI change summary?
The summaries can be viewed within the change history of a monitor as shown below. Additionally, you will also receive them in email alerts if email actions are set.
In the watchlist, click on the preview of the monitor’s text to open it’s change history. You will see the AI Change Summary highlighted in blue.
You can further explore the Diff in the change history to review the changes in detail.
Customizing Change Summary
You can provide a custom prompt to define what you want the change summary to contain. You can include as many details as necessary and specify any text you want to ignore.
This is can be done from the AI Summary Settings. Click on the hamburger icon -> AI Summary to view the settings page. Additionally, you can also click on “improve” link to go to AI Summary Settings.
AI summary settings is global for a Watchlist. The prompts apply to all monitors in your Watchlist.
Extracting Custom Fields
By default, two fields are provided under the AI change summary: change_summary
and important
. You can update prompts for these default fields to suit your needs. Additionally, you can create custom fields and add prompts for them.
Custom Field Naming and Types
- Custom Field Name: It is recommended to use a name without spaces. If multiple words are needed, use an underscore (_) to separate them.
- Custom Field Type: A custom field can be one of the following types:
Number
– Use this type if the field should contain only numeric values.Boolean
– Use this type if the field should have only two possible values:True
orFalse
.String
– Use this type if the field should accept any text.
Testing Updated Prompts and Fields
Once you update the prompts and fields in AI Summary Settings, you can test them from the right part of the AI Summary Settings and preview the new change summary. Select a monitor with a change history and click the Test
button. The new change summary result will show at the top of the default summary with current date and time of testing.
You can experiment with different prompts and refine them accordingly. Test
will work if there is a highlighted change history. Once you are happy with with the AI change summary results, click Save
to save the updated prompts and fields before exiting the AI summary details page.
Prompt Examples
Grant Application Openings & Deadlines
Prompt for change_summary
:
```
summarize changes to include anything related to
- deadline,
- new grant addition,
- update in dates for application
- application criteria change
- any call to action
do not summarize changes like:
- reordering of texts or elements
- translation or language updates
- changes in website structure
- social media changes
```
E-commerce Listing Changes:
You can update the default prompts for change_summary
and add fields such as seller_rating
, price
and provide prompts for them. One of them is shown in the following image.
Website Defacement
You can create custom field for detecting website defacement.
Create field `defaced` of type `boolean`. Example prompt:
```
the page is defaced if its original content has been replaced or updated with:
1. malicious content such as links to download malicious software
2. threatening messages or blackmails
3. added content contains any of the following keywords:
- keyword1
- keyword2
- etc.
```
When do monitors record AI summaries?
- AI summaries are generated only if the monitored text exceeds 200 characters. Otherwise, no summaries are produced.
- Summaries are generated only for Web page and PDF type monitors.
- The AI summary is available in the Enterprise plans and the Flexi plan for cloud monitors.
Distill uses LLM to generate AI summary. Be mindful that LLMs are susceptible to errors. Please verify actual data and changes.
Suggested Reading: