8 Oct 1998 ............... Length about 900 words (6000 bytes).
This is a WWW document maintained by
Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/mant/mantchiEval.html.
Web site logical path:
MANTCHI overall evaluation report
I have written a long (9,000 word) paper overviewing the educational
evaluation done on MANTCHI. It should be regarded as a draft, and comments of
all kinds are welcome.
Title: "Evaluating remote collaborative tutorial teaching
Authors: Steve Draper & Margaret Brown
This chapter overviews the integrative evaluation studies done during the
MANTCHI project. About 20 studies were done of the many deliveries. In this
chapter, some main conclusions each drawing on evidence from multiple studies
are presented, together with discussion on the strengths and weaknesses of the
method employed. Overall, the evaluation studies provided both formative and
summative results. The formative information for improving the overall
delivery of the material is exemplified by a selection of issues and
recommendations, and a sample of the evidence on which they were based. The
summative evidence on learning outcomes and quality suggests that the project
materials are at least as effective as other material, although by no means
always preferred by students. Our studies suggest however that the main gains
are in improved curriculum content and in staff development (expanding the
range of topics a teacher is confident of delivering), but that different
evaluation methods must be developed and applied to study that properly.
I expect to be using this for other things as well: in all
Below are links to a version sent to the ELT conference. The last 4 pages are
a reproduction of a questionnaire, and the format may get screwed up.
Postscript (if you click, you get a file you have to able to send
to a postscript printer. Beware: probably only works on A4 paper.)
(if you click you get a file. Open this from INSIDE Word, and you
will probably get a good version).
Web form of an earlier version (part of a bigger report)
- The ELT conference
which will also publish a book / proceedings.
M.Oliver (1998) (ed.)
Innovation in the evaluation of learning technology
(London: University of North London)
- A chunk /chapter in the project final report (I missed the interim report)
- Project deliverable item number 15 "Summative Project evaluation".
Web site logical path: