Index
Speaking of evaluations...
In Evaluations, users can manage all evaluations (i.e. creating new evaluations, editing, deleting, disabling, previewing their content, and viewing their versions).
Evaluations can be applied in pre-tests, post-tests or training/track/topic item evaluations.
Defining the evaluation type is not required, since any evaluation can be used as a pre-test, post-test, or reaction evaluation. This definition occurs whenever an evaluation is associated to a track/training course, topic, or class.
When associating an evaluation to a track/training course, you can define the passing and failing scores. The passing and failing scores for pre-tests are configured directly in the training course. For the post-test, the passing score in the track/training course is used for determining if the student has passed or not.
In topics, evaluations are topic items. Each topic item has a weight, which is calculated based on the evaluation score in order to obtain the final topic grade.
Reaction evaluations are applied to establish the level of satisfaction and learning of students in training, tracks and classes, allowing them to express their opinions regarding the respective courses and indicate strengths, weaknesses, criticisms and improvement suggestions.
Understand!
Do you want to understand how to calculate evaluation grades? Go to Calculating evaluation grades and learn all about it.
View existing evaluations
01. In the main menu, place the mouse over Evaluations.
02. Click Evaluations.
03. View existing evaluations. You can view specific evaluations by using the Search field located in the upper right corner of the window.
Create evaluation
01. Click New, in the upper left corner of the Evaluations window.
02. Click Edit – in the lower left corner of the image — if you want to add an image to the evaluation.
03. Find and select the image to be assigned as the evaluation image.
The maximum size allowed for the image is 4 MB.
04. In the pop-up window, define image crop.
05. Click Save.
To delete the added image, just click the Delete icon – in the lower right corner of the image.
06. Enter the name and description of the evaluation.
07. In the General information table, define the evaluation information.
All evaluation questions must be answered
When it is checked, the evaluation can only be completed after all of its questions are answered.
Allow open-ended questions
When it is checked, the evaluation may contain open-ended questions, which must be manually graded by the grader in charge.
Passing cutoff score
Minimum score required to pass the evaluation.
Minimum evaluation completion time (in minutes)
The minimum amount of time required to complete the evaluation, before which the evaluation cannot be completed.
Maximum evaluation completion time (in minutes)
The maximum amount of time in which students may complete the evaluation. After this period is elapsed, an expiration message appears and the evaluation is automatically canceled. Later, they will be ended by a default routine that runs periodically on the platform. For more information, see End expired evaluations.
08. In the More information table, define the other information to be assigned to the evaluation.
Display grade
When it is checked, the student grade is shown upon completion of the evaluation.
Show passing status
When it is checked, it displays the student’s passing status upon completion of the evaluation, that is, if they passed or not.
Show performance in each question
When it is checked, students can view their performance in each question after finishing the evaluation (correct/incorrect answers).
Show correct answers in each question’s performance
When it is checked, students can view each question’s correct answers upon completing the evaluation, regardless of whether their own answers were correct or incorrect.
Show evaluation completion message
When it is checked, a message is displayed to students upon completing the evaluation.
Completion message
Message displayed to students upon completing the evaluation. This field is only displayed if the ‘show completion message’ option is checked.
Request evaluation rating
When it is checked, students can rate the evaluation from 1 to 5 and add comments regarding the evaluation, upon completing the evaluation process.
Allow question comments
When it is checked, students can add comments to each test question during its execution.
Anonymous evaluation
When it is checked, the responding student’s information is not kept.
Allow resuming from the last point
When it is checked, the student can continue taking the evaluation if they close it and then pick up from where they left off, i.e., the time during which it remained closed will not be deducted from the remaining time to finish the evaluation. For example: the maximum evaluation completion time is 60 minutes. A student spent 20 minutes taking the examination and closed it. Two hours later, he picked up where he left off. In this case, the remaining time that he will have to finish the evaluation will be 40 minutes.
When this field is not checked and the evaluation execution window is closed, time is still counting.
For example: the maximum evaluation completion time is 60 minutes. A student spent 20 minutes taking the examination and closed it. If he does not open the evaluation again to continue taking it within the next 40 minutes, he will no longer be able to access it, because it will reach the maximum completion time.
The evaluations that were started, closed and reached the maximum time allowed for completion are automatically finished by the default task End expired evaluations.
Monitored evaluation
When it is checked, a monitor must oversee the evaluation’s execution. The monitor must enter his/her password to allow the student to take the evaluation. In this case, an evaluation monitor must be assigned in the Monitors chart displayed. To do so, click Add, select the user to be assigned as the evaluation monitor, and click Add once again. To delete an added monitor, select them and click Delete.
09. In Monitors, click Add to define the monitors for the evaluation.
10. In the pop-up window, find and select the user to be the monitor for the evaluation.
You can find the user that you want by using the Search field – located in the upper right corner of the window – or paging through users – arrows located in the lower right corner.
You can also select more than one user at once.
11. Click on Add.
12. After you finish adding the monitors, click Close.
To delete an added monitor, simply click the Delete icon, to the right of the line corresponding to the monitor.
13. In Graders, click Add to define the graders for the evaluation.
14. In the pop-up window, find and select the user to be the grader for the evaluation.
You can find the user that you want by using the Search field – located in the upper right corner of the window – or paging through users – arrows located in the lower right corner.
You can also select more than one user at once.
15. Click on Add.
16. After you finish adding the graders, click Close.
To delete an added monitor, simply click the Delete icon, to the right of the line corresponding to the monitor.
17. In the Blocks table, click New to create a question block for the evaluation.
This option allows you to create an exclusive question block for the evaluation. After the evaluation version is released, this block may be assigned as reusable for other evaluations. To do so, simply edit the evaluation and click Make block reusable, located on the right-hand side of the line corresponding to the block and, confirm the action in the pop-up message. After a block becomes reusable, it cannot be reassigned as exclusive. For more information on how to create question blocks, go to Blocks.
You can also import or copy a question block for the evaluation rather than create one. These actions are detailed in Import question blocks for the evaluation and Copy question blocks for the evaluation.
Later, when editing an evaluation whose version was released, it is possible to view block content by clicking Preview, located in the line corresponding to each block.
18. Define the information for the new block in the pop-up window.
Title
Title to be assigned to the question block.
Weight
Block’s weight within the evaluation. This value is used to calculate the final student grade for the evaluation. This default value is 1.
Order
Order in which the block is displayed during the evaluation. When the order of blocks is not defined in the evaluation, the blocks are ordered randomly. If there is more than one block with the same order, such blocks are displayed in sequence.
Minimum number of correct answers
Minimum number of correct answers required in block, i.e. if the student does not get that number of answers right, their grade in the block will be zero.
Allow zero score in the block
When it is checked, this option prevents students from failing it after incorrectly answering all block questions. Whenever this option is not selected, students who incorrectly answer all block questions automatically fail the evaluation.
All block questions must be answered
When it is checked, students may only move to other evaluation blocks after completing all questions in this specific block.
19. In Topics, click Add to add question topics to the evaluation.
20. In the pop-up window, define the information to filter the questions to be added to the block.
Type
Type of action to be performed. Available options are:
- Add: when it is checked, the selected topic questions will be added to the block.
- Delete: when it is checked, the selected block questions will be deleted from the block, that is, they will be disregarded.
Root topic
Topic tree containing the existing questions available for use. You have to find and select the topic of your choosing.
Level of difficulty
Difficulty range to be considered when filtering topic questions to be added or deleted from the question block.
With tags only
Tags to be considered when filtering questions to be added to or deleted from the question block.
21. Click on Add.
You can add more than one question topic to select them later.
To delete a topic added to the block, simply click the Delete icon, to the right of the line corresponding to the topic.
22. In Questions, define the ones to be added to the evaluation block.
All questions
When it is checked, all topic questions will be added to the block and displayed in the evaluation.
Some selected questions
When it is checked, only the selected questions will be added to the block and displayed in the evaluation.
Some random questions
When it is checked, only a certain number of topic questions will be added to the block and randomly displayed in the evaluation. Upon selection of this option, a field appears where the number of topic questions to be added to the block must be entered.
Quantity
Number of random questions to be added to the evaluation block. This field is only displayed when you select the option Some random questions.
23. Select the questions to be added to the block if the ‘some selected questions’ option is selected.
24. Click Save to complete setting up the question block.
25. Click Save again to confirm creating the evaluation; or Cancel if you want to discard all changes.
Importing question blocks for evaluations
Importing a block allows you to add a previously registered question block to the evaluation. In this case, you can change neither the filter nor the block questions; it will be applied to the evaluation exactly how it was configured.
01. In the evaluation creation or editing window, click the arrow next to New, in the Blocks table.
02. Click Import block.
03. In the pop-up window, find and select the block to be imported for the evaluation.
You can find the block that you want by using the Search field – located in the upper right corner of the window – or paging through blocks – arrows located in the lower right corner.
You can also select more than one block at once.
04. Click on Add.
05. After importing all the blocks, click the Edit icon, located in the line corresponding to the block, in order to define the features that the block will have within the evaluation.
The pop-up window is the same as the one to create a block. Therefore, for details about the fields that can be changed, see the steps for the creation of a block in the evaluation registration.
06. Click Save.
Copying question blocks for evaluations
Copying a block enables you to add a previously registered question block and configure it as desired, i.e. you can change its filter and the block questions to be added to the evaluation, in addition to the features that the block will have within the evaluation.
01. In the evaluation creation or editing window, click the arrow next to New, in the Blocks table.
02. Click Copy block.
03. In the pop-up window, find and select the block to be copied to the evaluation.
You can find the block that you want by using the Search field – located in the upper right corner of the window – or paging through blocks – arrows located in the lower right corner.
You can also select more than one block at once.
04. Click on Add.
05. After importing all the blocks, click the Edit icon, located in the line corresponding to the block, in order to define the features that the block will have within the evaluation and the questions to be added to the evaluation.
The pop-up window is the same as the one to create a block. Therefore, for details about the displayed fields, see the steps for the creation of a block in the evaluation registration.
06. Click Save.
Release evaluation version
01. Select the evaluation whose latest created version you want to release.
02. Click Edit.
03. Click Release version, in the upper right corner of the window.
This option is only displayed for evaluations that have a version under editing.
04. In the pop-up window, enter the description of the version to be released for use.
05. Click Release version.
When you click this option, the released version becomes the evaluation’s current and effective version, which is available for application.
Create new evaluation version
01. Select the evaluation for which a new version will be created.
02. Click Edit.
03. Click Create version, in the upper right corner of the window.
This option is only displayed for evaluations whose latest version has already been released.
04. Apply the evaluation changes for the new version.
05. Click Save.
Cancel evaluation version
01. Select the evaluation whose latest created version you want to cancel.
02. Click Edit.
03. Click Cancel version, in the upper right corner of the window.
This option is only displayed for evaluations that have a version under editing, because you can only cancel a version that has not yet been released.
04. In the pop-up message, click Yes to confirm the cancellation of the version under editing; or No if you want to cancel the action.
Edit evaluation
01. Select the evaluation to be edited.
02. Click Edit.
03. Change the information of your choice. For information on the displayed fields, go to Create evaluation.
04. Click Save to confirm; or Cancel if you want to discard all changes.
Delete evaluation
01. Select the evaluation to be deleted.
02. Click Delete.
03. In the pop-up message, click Yes to confirm the deletion of the evaluation; or No if you want to cancel the action.
Activate/deactivate evaluation
01. Select the evaluation to be enabled or disabled.
02. Click Activate.deactivate.
When you click this option, you change the evaluation status to enabled (if it is disabled) or disabled (if it is enabled).
Previous application scheduling for disabled evaluations are canceled and all involved users are notified.
Preview evaluation
01. Select the evaluation to be previewed.
02. Click Preview.
03. View the evaluation and its questions.
04. Click End to return to the main window.
View evaluation application statistics
01. Select the evaluation whose application statistics you want to view.
02. Click Statistics.
03. In the Students tab, view specific information regarding each responding student.
You can view statistical graphics on the right-hand side of the window.
04. Click the Questions tab to view detailed information regarding each evaluation question.
You can view statistical graphics on the right-hand side of the window.
Click Comments, located on the right-hand side of the corresponding question line, to view each question’s comments.
To return to the main window, click Back.
Please note!
This documentation is valid as of the 1.6.4 – Waterdrop – 180508 update. Previous updates may contain different information than what you see on your platform.
Visão Geral
Import HTML Content
Conteúdo das Ferramentas
Tarefas