Evaluation

**Evaluation** is the assessment of the online design during its' design. Evaluation is a process used to judge the "worthwhileness" of something in order to make decisions (Clark, 2000) cited in (Dabbagh and Ritland, 2005). This section looks at the evaluation plan for the Online Learning activity and then looks at the responses given by respondents on the Online Learning activity. An analysis of the responses is given.  **Evaluation Plan** The evaluation will be made by getting comments from peers and educators. In order to get comments on the prototype, I will develop a form, using Google Docs that I will email to the evaluators of the Online Learning Activity. The form [| Using Chat Tool in a Learning Management System] will be filled in online and then emailed back to me. The form with eight(8) questions can be completed in less than ten (10) minutes. I chose using a form for evaluation as it could be filled in at a convenient time by the evaluator.

**Evaluation of the Online Learning Activity** The evaluation was of the blog [|e-Learning in TEVET] was done by four (4) participants. These were drawn from lecturers and policy makers. I sent an e-mail with the form attached and also a link to the form to the participants. The e-mail explained how long filling in the form would take and how it should be returned to me and when.

**Summary of Responses** The summary of responses given by the evaluators is shown in the link [|Summary of Responses]

**Question 1** was on whether the blog gave clear instructions on the use of the Chat tool in Moodle. A total of 75% agreed and strongly agreed that the blog gave clear instructions on how to use the Chat tool in Moodle. The other 1 making 25% was uncertain.  **Analysis of Response** The high number of respondents that responded that the blog gave clear instructions on the use of that Chat tool could be due to the blog being short and thus easy to read in a short time and follow. Also the use of a diagram and a video could have made it easier for the respondents follow the steps on how to use the Chat tool in Module.

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 2** sought to find out if using a blog was a suitable way to explain how to use the Chat tool in Moodle. A total of 50% responded that it was, while 50% were not certain. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"> **Analysis of Response** <span style="font-family: 'Comic Sans MS',cursive; font-size: 120%;">The response being evenly divided between those that said using a blog was a suitable way to explain how to use the Chat tool in Moodle could be because those that did not think so have never used blogs before or if they have, they do not realise the educational value of blogs. It would be useful to include links on the educational value of blogs for persons in this category.

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 3** was on whether the diagram in figure 1 in the blog helped to clearly illustrate the use of Chat in Moodle. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">A total of 50% responded that it was, while 50% were not certain. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"> **Analysis of Response** An equal number of respondents stating that the diagram in the blog helped to clearly illustrate the use of Chat in Moodle could be due to the diagram being "still" and not interactive! If the diagram was an interactive one with some simulation as recommended by one of the respondents this could help.

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 4** was on whether the video on the blog helped to clearly illustrate the use of Chat in Moodle. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">A total of 50% responded that it was, while 50% were not certain. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Analysis of Response** <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Those that responded that they were uncertain on the video on the blog helped to clearly illustrate the use of Chat in Moodle could be due to those that had difficulties in opening the video due to bandwidth challenges and also type of browser used. I noted that the Youtube video was easier to play using Google Chrome browser than in other browsers. This maybe because Google Chrome and Youtube being Google Applications. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 5** was on whether the blog enabled users to ask any questions they may have. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">A total of 50% responded that it did, while 50% were not certain. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Analysis of Reponse** <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Those that were not certain on whether the blog enabled users ask any questions that they had could have said so as they may not have fully appreciated the use of the comments section on the blog where readers can post comments. It is possible that they could not have seen it since it is right at the bottom. In addition the respondents may not have been aware that the blog chat window on the right could be used to chat with the blog owner! Including some instructions on how to comment and ask questions on the blog would be useful to elicit comments from the readers.

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 6** sought for an explanation for the answer given in question 5. The responses given were that:

<span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">th e blog was quite interactive and detailed explanations could be made. Sometimes it may fail to give you the answer you require accurately. The comment section allows for that. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Analysis of Response** <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">The response on the blog failing to give an answer that one requires correctly implies that a blog may not entirely anticipate all possible learning challenges. It os for that reason that comments by readers provide a means for such questions to be addressed. In some cases the blog creator may not have the appropriate response. But other readers may have useful responses! <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 7** sought responses on the challenges faced in using the blog. The responses given were:
 * <span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; line-height: 23px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">None (from 2 respondents).
 * <span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; line-height: 23px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">I was not able to play the video
 * <span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; line-height: 23px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Not being very accurate in giving answers

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Analysis of Responses** <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">The response "I was not able to play the video" is a challenge that many online learning designers are likely to face especially when dealing in developing contexts. Putting the video on DVDs which can be played off-line or using video tapes maybe one way of addressing such challenges.

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Question 8** was on how the blog could be improved to make it easier for users to learn how to use the Chat function in Moodle. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">The responses given were:
 * <span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; line-height: 23px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Any possibility of using simulations especially for practical illustrations?
 * <span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; line-height: 23px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">The explanation is clear and to the point. The challenge is the computer I use may not have the software to support videos from Youtube. Otherwise its a good platform to interact through simplifying the basic skills of computer literacy.
 * <span style="background-color: #e7e7e7; display: block; font-family: 'Comic Sans MS',cursive; font-size: 16px; line-height: 23px; text-align: justify;"><span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Design not up to standard.

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**Analysis of responses** <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">The proposal to use simulations is valid. This could help in making it easier to follow each step in using the Chat tool in Moodle. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">The purpose of an educational simulation is to motivate the learner to engage in problem solving, hypothesis testing, experiential learning, schema construction, and development of mental models (Winn & Snyder, 1996; Duffy & Cunningham, 1996). To facilitate learning, educational simulations rely heavily on scaffolding (Duffy & Cunningham, 1996), coaching, and feedback (Alessi & Trollip, 2001).

<span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">**<range type="comment" id="289750">References ** <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Alessi S. M. & Trollip, S.R. (2001) //Multimedia for learning: Methods and development (3rd Ed.).// (214, 254-257). Boston: Allyn & Bacon. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;"> <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Clarke, R. E. (2000) Evaluating Distance Education: Strategies and Cautions. //The Quarterly Review of Distance Education//, 1(1), 3-16. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Dabbagh, N., & Bannan-Ritland, B. (2005). //Online learning: Concepts, strategies, and application//. Upper Saddle River, NJ: Pearson Merrill Prentice Hall. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Duffy, T. & Cunningham, D. (1996) //Constructivism: Implications for the Design and Delivery of Instruction//. In D. Jonassen (Ed.), Handbook of research on educational communications and technology. New York: Simon & Schuster. <span style="display: block; font-family: 'Comic Sans MS',cursive; font-size: 120%; text-align: justify;">Winn, W. & Synder, D. (1996) //Cognitive perspectives in psychology//. In D. Jonassen (Ed.), Handbook of Research on Educational Communications and Technology. New York: Simon & Schuster.