Why do some violations have missing evidence?
Summary: Each test attempt has a maximum number of evidence files it can store. If some violations have missing evidence files, the total number of violations exceeded this maximum number.
Violation - An event that AutoProctor detects which is anomalous. For example, if there is no face being detected on the camera feed. Or if a test taker switches to a different tab
Evidence - Evidence of the violation. For example, a photo of the camera feed when no face was detected. Or, a screenshot of the tab the test taker visited when they switched the tab
The Trust Score is calculated on the basis of the (i) type, (ii) frequency and (iii) duration of violations. The evidence files are made available in the Proctoring Report so that the test administrator can review what may have happened.
There could be 3 reasons. In decreasing order of likelihood, they are:
When a test taker starts the test, AutoProctor assigns a fixed number of URLs where it stores the evidence. For example, let's say this number is 30. So, whenever a violation occurs, the evidence is uploaded onto one of the 30 URLs. If a 31st violation occurs, AutoProctor randomly if it must overwrite one of these 30 URLs with the evidence of the new violation, or not store the evidence for the new violation. This decision is randomized, with a 50% chance.
If the former occurs, then the earlier violation doesn't have evidence anymore. If the latter occurs, the newer violation won't have evidence.
The Trust Score depends on violations, not on whether evidence is stored. So, in the example above, the Trust Score will be based on 31 violations, not 30.
The candidate's device or internet connection may have prevented the screenshot from being captured, or transmitted
The test administrator may have enabled the setting to not store evidence. For example, on a test on AutoProctor, you can choose to not save the evidence files.
Violation vs Evidence
Violation - An event that AutoProctor detects which is anomalous. For example, if there is no face being detected on the camera feed. Or if a test taker switches to a different tab
Evidence - Evidence of the violation. For example, a photo of the camera feed when no face was detected. Or, a screenshot of the tab the test taker visited when they switched the tab
The Trust Score is calculated on the basis of the (i) type, (ii) frequency and (iii) duration of violations. The evidence files are made available in the Proctoring Report so that the test administrator can review what may have happened.
Why do some violations have missing evidence?
There could be 3 reasons. In decreasing order of likelihood, they are:
1. Not enough URLs
When a test taker starts the test, AutoProctor assigns a fixed number of URLs where it stores the evidence. For example, let's say this number is 30. So, whenever a violation occurs, the evidence is uploaded onto one of the 30 URLs. If a 31st violation occurs, AutoProctor randomly if it must overwrite one of these 30 URLs with the evidence of the new violation, or not store the evidence for the new violation. This decision is randomized, with a 50% chance.
If the former occurs, then the earlier violation doesn't have evidence anymore. If the latter occurs, the newer violation won't have evidence.
The Trust Score depends on violations, not on whether evidence is stored. So, in the example above, the Trust Score will be based on 31 violations, not 30.
2. Device or internet issues
The candidate's device or internet connection may have prevented the screenshot from being captured, or transmitted
3. Test's proctoring setting
The test administrator may have enabled the setting to not store evidence. For example, on a test on AutoProctor, you can choose to not save the evidence files.
Updated on: 05/14/2024
Thank you!