Working with results and chat in AssureAssist

Once documents are uploaded, AssureAssist produces a result for each criterion in the gate review. Use the results to focus your review. They show where evidence looks strong, limited or contradictory, so you can decide where to dig deeper, what to test in interviews, and where to ask for more evidence.

If a new document is uploaded after the review has started, tell the Assurance Lead so they can regenerate the results.

Results are a starting point, not findings.

1. Select ‘Results’ in the left-hand menu.
2. Wait for the results to load. This can take around 10 to 15 seconds. A magnifying glass shows while they load.

Each result appears as a row with 4 columns.

1. Select the funnel icon next to the column you want to filter.
2. Choose how to filter or sort.

You can filter by criterion, category or status.

To filter by criterion, choose ‘Contains’ or ‘Begins with’, then type your term. Results filter as you type. You can add a second term using ‘and’ or ‘or’.

Select the result you want to review. A panel opens showing:

• the gate review question
• tags for the outcome (positive, neutral or negative), the question category and the gatew stage
• the AI justification, explaining how AssureAssist reached this result
• the evidence considered, showing the evidence behind the result
• the sources, showing which documents relate to this criterion
• helpful and not helpful icons, so you can give feedback on the output

Select ‘Ask a question’ under ‘AI justification’ to open the chat and ask more about this result. See Using the chatbot.

1. In the result panel, under ‘Sources’, select the document you want to check.
2. Select ‘Summary’ for an AI-generated summary, or ‘Viewer’ for the full document.

This lets you check AssureAssist’s result against the actual evidence without clicking back and forth between documents.

1. Select the thumbs icon marked ‘helpful’ or ‘not helpful’.
2. Add your reasoning (optional).
3. Select ‘Submit feedback’.

You can give feedback on a single result. This feeds into insights for future improvements to AssureAssist.

‘Ask a question’ is an AI chatbot built into AssureAssist. Use it to understand why a criterion got the outcome it did, or to refine and explore question areas.

You can open the chatbot in 2 ways. Either:

• select a criterion in the results section, then select ‘Ask a question’ under ‘AI justification’ to start a conversation about that result
• select ‘Ask a question’ in the left-hand menu, under ‘Review’

You can choose which large language model (LLM) the chatbot uses to produce outputs. The options are currently:

• Claude 3 Sonnet (default)
• Claude 3 Haiku
• Llama 3 70B Instruct
• Mistral Large (24.02)

Your chatbot conversations are private to you. No one else on the review can see them. Conversations are saved on the left so you can return to them.

The chatbot only works with the documents uploaded for the review. It cannot access the internet or anything outside the review’s scope.

The chatbot uses AI, and AI can produce answers that are wrong or misleading, even when they sound convincing. Always check anything important against the source documents before you rely on it or use it in your report.

The chatbot has prompt guidance below the chat panel. You can use a suggested prompt from popular questions and edit it, or write your own. The prompt guidance also includes tips for writing effective prompts and using the chatbot.

When the chatbot produces an answer, it links to the documents it used at the bottom of the answer. Select these links to open and review the sources.

Use a suggested prompt

1. Open the prompt guidance and select a prompt. It appears in the chat bar at the bottom.
2. Edit it if you want to.
3. Select the send button.

Ask your own question

1. Type your question in the chat bar.
2. Select the send button.