Web site logical path: [www.psy.gla.ac.uk] [~steve] [apr] [this page] [popup1] [popup instructions] [APRintro] [ex1] [software notes]
This page is about a post-course optional exercise likely to be of interest to students on the PosPsy course. (CERE course web page CERE course moodle page)
The aim of this exercise is to produce a ranking of some student-written wiki from past years of this course, which could assist students' selections of topics for revision. It does this by using students' collective judgements of the helpfulness of the wikis. The ranking data should also give us a measure of the degree of consensus, or spread of opinions, as well. I expect to make this available on the course Moodle page.
Instead of a conventional voting system, the exercise uses a novel method I call APR (Assessment by Pairwise Ranking) where each participant gets a series of pairs of wiki pages, and simply says which they think is the better of each pair on the given criterion. Participants, including professional exam markers, are reported to find this easier and "better" than normal marking. So, besides being more likely to acquire your cooperation, this will be an interesting method for you to experience. (A brief introduction to the thinking behind the method is here.)
When you're ready to try it (but you might first want to look over what's below on this page), then go to the course moodle page, and follow the instructions in the box "Optional follow-up exercise".
It is generally best to spread your contribution to the ranking over several times. (This is because the software saves overall work, but uses early ranking judgements to estimate which discriminations are essentially clear; and which are going to be close to each other and therefore require more "votes" i.e. comparisons to clarify. Furthermore, it may be most informative to you to do some very early on, when you get many pairs of very different quality to each other; but we will also need plenty of similar quality pairs later on to firm up exact orderings.)
It can be done online, and/or in a booked room.
It needs a large screen i.e. laptop or desktop, not a phone screen, in order to make the wiki PDFs readable.
Where -- room booking: I have booked a room to allow for a group session where you can discuss both the method and the rankings with each other, and ask me about this whole process. This is Wednesday 23 March, 2pm-4pm in BO 603 (psych labs). You will be able to login to the computers in the labs; or bring a laptop and connect via WiFi.
When you're ready to try it (but you might first want to glance over what's
below on this page), then go to the
course moodle page,
and follow the instructions in the box "Optional follow-up exercise".
Use a machine with a large screen (phones are too small for this software to give you a good look). Don't use the browser Internet Explorer (too slow for this): university computers also have Chrome as standard, if you look for it.
"Vote early, vote often"