Digitized Training on How to Run CES Test Using AI Proctoring

Overview

The Crew Evaluation System (CES) is here to help assess the background knowledge of seafarers. It’s an online tool that identifies specific training needs related to the knowledge areas outlined in STCW.

This professional training demonstrates the integration of AI proctoring within the Crew Evaluation System (CES). Learn how CES assesses seafarer knowledge against STCW standards and how AI proctoring ensures exam integrity. The video guides you through scheduling proctored tests, understanding confidence ratings, and reviewing proctoring reports for effective candidate evaluation and development.

CES helps highlight the strengths and weaknesses of candidates, making it easier to select individuals based on their skills and experience. It's also useful for planning additional training and development opportunities to address any gaps and enhance potential.

You can run the CES Test with the support of AI, which helps determine if the applicant completed the exam independently, without external materials.

The results of the exam can be interpreted as follows:

Once processed, the test result will provide a confidence rating of high, medium, or low.

High – indicates a high level of confidence in the result. The test result will be automatically approved. However, we suggest you take a moment to review the video.

Medium – suggests a medium level of confidence. There may have been occasional rule violations, such as multiple individuals detected or navigating away from the test. You will need to review the footage to assess the candidate’s activity and decide whether to approve or reject the result.

Low – indicates a low level of confidence in the result. Frequent rule violations may have occurred, such as multiple individuals detected or navigating away from the test. It’s necessary to review the footage to evaluate the candidate’s activity and determine whether to approve or reject the result.

To run the AI Proctoring Function of CES, please follow the steps below:

Schedule a proctored CES test

To schedule a proctored test, access the applicant or personnel's profile card.
Click on the Schedule tab, then the Individual requirements tab.
Select +Add CES schedule.

Choose the test type and click Schedule Test.

Select AI Proctoring to proctor the test, deducting one credit from your balance.
For applicants, enter their email address.
Credits will be refunded if the test expires or is deleted before completion (applicants only).

Multiple operations
You can schedule proctored tests for multiple personnel or applicants simultaneously. Choose Multiple applicant (or personnel) operations, select users, and choose CES Scheduling from the dropdown.

Select the CES test type and enable AI Proctoring. One credit will be deducted per scheduled test. Applicants must have an email address.

How to review CES results?

After the test, results are found under the “Records” tab in STA. Click on the test for details. To print a report, click on “Reports.”

Reviewing proctored assessments

Post-completion, the test result (score) will be available. The video will be uploaded and processed, taking 5-20 minutes, up to two hours for longer videos.

Results will show a confidence rating: high, medium, or low.
 

High – high confidence in the result. The test result will automatically be approved. However, we recommend you still have a brief look at the video.

Medium – medium confidence in the result. Occasionally violated rules such as multiple people detected or navigated away from the test. You will need to review the footage to check the candidate’s activity and approve or reject the result.

Low – low confidence in the result. Frequently violated rules such as multiple people detected or navigated away from the test. You will need to review the footage to check the candidate’s activity and approve or reject the result.

To review the result, click Details

Click Details to review the result.

This will show the test proctoring report. This will include Applicant information include name, photo, IP, OS, browser type etc.

Video footage recorded during the test. You can quickly scrub the timeline to check for anything unusual.

Audio waveform capture. If the applicant was taking talking during the test, you should see this in the waveform. 

You can scrub the video to that section to listen.

Screen shots are captured every 10 seconds. You can hover over the thumbnail for a larger view.
 

The event Log will show a list of all events that were captured. You can click on an event to jump to that section of the 
video.