Skip to main content

How to use OCR to detect sensitive on-screen content

Introduction

Teramind's Optical Character Recognition (OCR) feature is an advanced security tool that continuously analyzes, captures, and indexes all text displayed on a user's screen. This allows you to discover and protect sensitive data such as PII and PHI. You can utilize this feature in two primary ways: by manually searching across recorded sessions or by setting up automated rules for real-time detection and response.

OCR Search with the OCR Dashboard

For forensic investigations, use the OCR dashboard to quickly search for sensitive text using keywords, phrases, or Regular Expressions:

1. From the main menu, click OCR. The OCR dashboard will open.

2. Optionally, narrow down the search with the filters at the top of the screen: the date range (e.g., Oct 14 - Oct 20), All Employees, All computers, and Search apps / websites.

3. Enter the text you want to find in the Search session text field (e.g., credit card).

4. Select how the text should be matched from the Text dropdown. You can use Contains when searching for normal text and phrases and Regexp when searching for a pattern using regular expressions.

5. Click the Search button. The matching results will appear as a grid. The matched text is highlighted in the Text column.

6. Click the Camera icon next to a result to view the snapshot of the screen when the text was captured. Click the Close button to return to the results.

7. Click the Movie Camera icon next to a result to open the Session Player in a new window and watch the recording from that moment.

Automated OCR Detection with the OCR Rule

You can use the OCR Activity rules to detect text on screen in near real-time and optionally, trigger an action to get notified when the incident happened.

The sample rule below uses a Regular Expression to detect number patterns such as credit cards on screen:

1. Navigate to the Configurations > Behavior Policies menu.

2. Click the New Rule button. The New behavior rule screen will open on the General Settings step.

3. Enter a name for the rule in the Rule Name field (e.g., OCR Test). Optionally, enter a description in the Rule Description field (e.g., Detect credit card numbers on screen).

4. Select the policy the rule will belong to from the Parent Policy dropdown (e.g., Security).

5. For Rule Type, select Activity.

6. Under Select the type of activities, turn on OCR. Optionally, adjust the Rule violation severity and Time when rule is active settings, then click the Continue button.

7. On the Employees step, keep the Inherit targets from Parent Policy option on to apply the rule to the parent policy's targets (e.g., External Contractors and Compliance, excluding Dan Howell and Fang Shen). Alternatively, turn it off and choose who the rule applies to in the Assign to and Exclude from rule fields. Click the Continue button.

8. On the OCR step, click Add under Condition 1 and select On-screen text.

9. In the On-screen text field, specify the text you want to detect. You can enter keywords or a regular expression, or select a Shared List (e.g., Matches list member Job Sites). In this example, we used a regular expression that detects credit card number patterns and selected Regular expression match. Click the Continue button.

10. On the Actions step, turn on Notify to get notified when the rule is violated. Select the recipients from the Add an employee list, or type an email address and click Add.

11. Click the Submit Rule button to save the rule and turn it on. A Behavior rule saved successfully message will appear.

Did this answer your question?