Add Scorecard Automated Evaluation

Automated Evaluation uses AI to assess scorecards. Compared to Manual Evaluation, it offers a broader set of evaluation criteria. These include Adherence Phrase, AI Adherence Phrase, and AI Questions derived from Policy Rule Triggers, see Tab Policy Rules Triggers. This allows the system to leverage existing definitions already configured in Recording Insights, enabling seamless integration with previously defined compliance and policy rules. In addition, Automated Evaluation supports two further evaluation types:

New QM Question: Is identical in structure to the one used in Manual Evaluation but is scored with AI support.
Manual Question: Is not evaluated by AI. It is available exclusively within Automated Evaluation and allows for a hybrid approach, combining AI-based scoring with manually assessed components. This enables more nuanced evaluations where certain aspects are handled by AI, while others remain under the evaluator’s control.

A key advantage of this feature is that the evaluation is primarily performed by AI, significantly reducing manual effort. At the same time, manual questions can be added to complement the AI-based assessment where needed.

Furthermore the scoring options Yes/No question and Awarding Points are only available for AI Questions, New QM Questions, and Manual Questions. The evaluation types Adherence Phrase or AI Adherence Phrase are scored automatically by the system and result in either full or no points, without intermediate values.

Scorecard Elements Automated Evaluation

Adjust the required settings:

Legend	Option / Function	Description
1	Automated Evaluation	Move the slider to Automated Evaluation to use the automated evaluation.
2	Upload	To increase efficiency, there is the option to upload a CSV file to the Scorecard Elements. The imported data will automatically flow into the Scorecard Elements. Click on to upload a CSV file. NOTICE! If a scorecard has already been partially configured manually, uploading a CSV file will overwrite the existing Scorecard Elements. The following error message will occur before the import proceeds:
2	Add Section	Sections form the foundational structure of a scorecard. They are required for setup and can include several evaluation criteria to assess different aspects of performance. You can rearrange the order of the sections flexibly using the arrows. Click on Add Section to add a new Section. Click into the text field to enter a meaningful name.
3	Add Evaluation	Each evaluation criteria belongs to a section. In the context of Automated Evaluation, there are five options to select as criteria, four of them use AI. Click on the button Add Evaluation, below the section, to add a new evaluation criteria. Select the desired criteria from the drop-down list. You can choose between five criteria: Adherence Phrase: All preconfigured Adherence Phrases are available. Select from list. AI Question: All preconfigured AI Questions are available. Select from list. AI Adherence Phrase: All preconfigured AI Adherence Phrases are available. Select from list. New QM Question: New QM Question works with AI. Enter a question directly in the text field. Manual Question: Manual Question works manually. Enter a question directly in the text field. Based on the selected criteria, enter a question or select an item from the list. This example shows the combination of an AI Question that is evaluated by AI and a Manual Question that is evaluated manually. Use the toggle switch to define how the evaluation criteria should be scored later on. You can choose between a Yes/No question or Awarding Points: Yes/No: Either full or zero points can be awarded Awarding Points: Allows to assign any value within the defined range, including decimal numbers.