AI Change Summary

Available in the Enterprise Plan and the Flexi Plan.

Table of Contents

AI Change Summary provides concise summaries of website changes.

Why Use Change Summary

  • Provides you quick access to important changes without the need to navigate through the change history or explore Diff.
  • Useful if you are monitoring full-page or large-section changes with a high volume of updates.
  • You can use Distill’s API to get summary data and integrate into other apps.
  • Allows you to add and describe custom fields to capture specific data for inclusion in the AI summary.

Steps to enable AI summary:

  1. In your watchlist, click the hamburger icon.
  2. Select AI Summary from the list to open the AI Summary Settings.
option to enable ai summary
  1. Toggle the Summarize Changes to “On”.
option to enable ai summary

Where to view the AI change summary?

The summaries can be viewed within the change history of a monitor as shown below. Additionally, you will also receive them in email alerts if email actions are set.

In the watchlist, click on the preview of the monitor’s text to open it’s change history. You will see the AI Change Summary highlighted in blue.

change summary of web page changes

You can further explore the Diff in the change history to review the changes in detail.

Customizing Change Summary

You can provide a custom prompt to define what you want the change summary to contain. You can include as many details as necessary and specify any text you want to ignore.

This is can be done from the AI Summary Settings. Click on the hamburger icon -> AI Summary to view the settings page. Additionally, you can also click on “improve” link to go to AI Summary Settings.

AI summary settings is global for a Watchlist. The prompts apply to all monitors in your Watchlist.

Extracting Custom Fields

By default, two fields are provided under the AI change summary: change_summary and important. You can update prompts for these default fields to suit your needs. Additionally, you can create custom fields and add prompts for them.

Custom Field Naming and Types

  • Custom Field Name: It is recommended to use a name without spaces. If multiple words are needed, use an underscore (_) to separate them.
  • Custom Field Type: A custom field can be one of the following types:
    • Number – Use this type if the field should contain only numeric values.
    • Boolean – Use this type if the field should have only two possible values: True or False.
    • String – Use this type if the field should accept any text.

Testing Updated Prompts and Fields

Once you update the prompts and fields in AI Summary Settings, you can test them from the right part of the AI Summary Settings and preview the new change summary. Select a monitor with a change history and click the Test button. The new change summary result will show at the top of the default summary with current date and time of testing.

test results of change summary after prompt update

You can experiment with different prompts and refine them accordingly. Test will work if there is a highlighted change history. Once you are happy with with the AI change summary results, click Save to save the updated prompts and fields before exiting the AI summary details page.

Prompt Examples

Grant Application Openings & Deadlines

Prompt for change_summary: ``` summarize changes to include anything related to - deadline, - new grant addition, - update in dates for application - application criteria change - any call to action

do not summarize changes like:
- reordering of texts or elements
- translation or language updates
- changes in website structure
- social media changes
```

E-commerce Listing Changes:

You can update the default prompts for change_summary and add fields such as seller_rating, price and provide prompts for them. One of them is shown in the following image.

test results of change summary after fields addition

Website Defacement

You can create custom field for detecting website defacement. 
Create field `defaced` of type `boolean`. Example prompt:
```
the page is defaced if its original content has been replaced or updated with:

1. malicious content such as links to download malicious software
2. threatening messages or blackmails
3. added content contains any of the following keywords:
- keyword1
- keyword2
- etc.
```

When do monitors record AI summaries?

  • AI summaries are generated only if the monitored text exceeds 200 characters. Otherwise, no summaries are produced.
  • Summaries are generated only for Web page and PDF type monitors.
  • The AI summary is available in the Enterprise plans and the Flexi plan for cloud monitors.

Distill uses LLM to generate AI summary. Be mindful that LLMs are susceptible to errors. Please verify actual data and changes.

Suggested Reading:

Was this article helpful? Leave a feedback here.