1/28/2021 – Version B.21.01


Version B.21.01 consisted of some technical improvements to the assessment including a more direct and stable connection to IBM Watson for scoring. Prior collected data was rescored via this connection and informed a slight update to the scoring algorithm. 

NOTE: Which user confirms the update to this version will be recorded in the version history.

Technical Details

What’s improved

  • Direct to IBM Watson Scoring
  • Scoring algorithm update


5/05/2020 – Version B.20.05


Version B.20.05 this was a minor update in test content. The items selected for the form was adjusted to optimize those that would most accurately reflect ability as scored by the automated scoring solution. 

NOTE: Which user confirms the update to this version will be recorded in the version history.

Technical Details

What’s improved

  • Updated items in form to optimize scoring using IBM Watson.


5/01/2020 – Version A.20.05


Version A.19.03 was the first version for the German Speaking Assessment. We conducted a calibration pilot to determine the item and ability parameters to create an assessment form and accompanying scoring algorithm to best predict German speaking ability. 

NOTE: Which user confirms the update to this version will be recorded in the version history.

Technical Details

What’s improved

  • Used Rasch infit/outfit statistics to screen calibration data to the most informative items and response patterns.
  • Incorporated regression model to predict ability with a high-degree of reliability