Document Viewer: Rater

Documents are always rated with respect to a group, so before you can use the rater, groups must be visible in the Document Viewer.

Opening the Rater

  1. Open the Groups Tool and highlight one or more groups.

  2. Open the Document Viewer.

  3. From the Document Viewer, choose Settings > Groups & Evidence Ratings. Columns corresponding to the highlighted groups will be added to the document table.

  4. To rate a document with respect to a group, click in the cell that is the intersection of the document (row) and the group (column). The Document Rater will open.

The Document Rater allows you to mark a document as supporting or refuting a hypothesis (3 levels), with what confidence (3 levels), unrated or irrelevant (not a member of the group). Composite ratings will be found in the Ratings with individual ratings in the Document Viewer.

Rating Documents in the Document Viewer

Using the Rater

Adjust the rating by clicking anywhere in the colored top half of the Rater window or by clicking and dragging the black diamond to the desired location. You can set a cell to Unrated or Not a Member or Ambiguous by clicking the buttons at the bottom of the window.

Document Rater - Indeterminate Evidence

Initially, all documents which belong to a group are unrated as indicated by the gray rectangle.

Document Rater - Unrated Evidence

If a document does not belong to a group, in the table the cell will be empty and in the rater this is shown with a white rectangle.

To remove a document from a group, click Not a Member in the Rater. Notice that the number of documents in the group and the Total Docs decreases by the number of documents that are removed when you do this. The document continues to appear in the list in the Document Viewer.

Document Rater - Ambiguous Evidence

If you find a document that contains conflicting information (data in the document supports its membership in the group, and data that argues against its membership in the group) select the Ambiguous option from the Document Rater (the gray diamond).

Document Rater - Supports Evidence

If a document supports the hypothesis of the group, select Supports (right-facing triangle) with the appropriate confidence and strength. The stronger the confidence and strength, the larger the green arrow will be.

Document Rater - Negates Evidence

If a document refutes the hypothesis of the group, select Refutes (left-facing triangle) with the appropriate confidence and strength. The stronger the confidence and strength, the larger the red arrow will be.

Simultaneously Rating Multiple Cells

Select a contiguous group of cells by clicking in one cell and SHIFT-clicking in another cell. The first (top) document's content appears in the content pane, and the Rater shows the top-left most evidence rating. Any rating you set in the Rater will apply to all the selected cells.

Navigating Between Ratable Cells Using the Arrow Keys

Using arrow (cursor) keys to navigate between ratable cells can be a great time saver when you are rating a number of documents.They can be used for navigation whenever either the table at the top of the Document Viewer or the Document Rater has focus. The keys behave as they usually do:

You can move through any cell in the table using the arrow keys. If the selected cell is ratable, the Rater will appear; otherwise, it will not.

Setting a Rating Using the Numeric Keypad

Whenever the table at the top of the Document Viewer or the Document Rater has focus, the numeric keypad keys (numbers 0-9) can be used for setting ratings. The four arrow keys allow you to navigate between cells and the numeric keypad allows you to rate documents without using the mouse. This can be a great time-saver.

Turn on number lock (Num Lock).

It helps to envision the numeric keypad alongside the Document Rater.

7 8 9

4 5 6

1 2 3

0

Document Rater - Indeterminate Evidence

The four corners (7,9,1,3) set four common ratings:

7 = max Refutes

9 = max Supports

1 = mid Refutes

3 = mid Supports

0 = Not a Member

5 toggles Ambiguous and Unrated

the decimal point = Reset.

The four cardinals '8' and '2' increase and decrease the confidence; '4' and '6' increase and decrease the strength.

For example: Start with a "Supports" rating and alter the confidence (more/less,up/down,8/2) and the strength (stronger/weaker,right/left,6/4). Starting with a "Refutes" rating, the strength and confidence can be adjusted similarly.

Ratings that are calculated

Ratings that have changed

Ratings that have undergone a major change will be marked with a "!". These may have been changed from supportive to refutive, or vice-versa; changed from either supportive or refutive to ambiguous; or changed from ambiguous to either supportive or refutive.

Diagnostic evidence

In the "D" column, a document is marked if there is at least one supporting and one refuting rating between the highlighted groups, or if there is at least one ambiguous rating between these groups.