Latest edits: Monday, 25 March 2013, 12:30 PM (RORY VOKES-DUDGEON); Monday, 25 March 2013, 12:27 PM (RORY VOKES-DUDGEON); Monday, 25 March 2013, 12:26 PM (RORY VOKES-DUDGEON); full history

Human Tutoring: Further Exploration into the work of Chi, Roy, and Hausmann (2008).


  • Introduction

  • Summary of Aims

  • Theory: the Active/Constructive/Interactive Observing Hypothesis

  • The Experimental Evidence

  • Critiquing the work of Chi and colleagues.

  • Relating the Evidence to Real-life

  • Conclusions

  • Relating the paper to 5 other course topics

  • Additional References



Introduction:


Human tutoring and collaborating with peers are two of the most common methods of learning. Of all of the methods that have been researched to date, one-on-one tutoring has been found to be the most effective method (Bloom et al., 1984). However, this form of teaching is generally reserved for select groups of students as it is not cost-effective. This is due to the large ratio of paid-staff to students. 


Aims of the Primary Paper:


This paper, by Chi, Roy, and Hausmann (2008), looks to understand why human tutoring is so effective and to develop a more cost-effective program which can produce the same effect size as one-to-one tutoring.


The Active/Constructive/Interactive Hypothesis

(created by CLAIRE JOHNSTONE on Thursday, 21 March 2013, 12:32 PM )

From the learning environment literature, Chi et al. (2008) identified that observing an another individual's learning was a less effective learning method than being tutored. The interaction with an expert appeared to be more successful than simply watching and listening to someone else with a tutor. Therefore, Chi et al. explored a way of improving observing learning to the same standard as tutoring.

Chi explained that within past studies, students who observed other student's learning were doing so passively in that there was no interaction occurring therefore it is unknown if the students were actively engaged in the process or not. She suggested that it could be the interaction with the tutor that makes this method superior to observation not the actual tutor. Therefore, whether observing students are able to learn more if they are allowed to be interactive, actively engaged and constructive during the learning process was investigated.


The Experimental Evidence

(created by CLAIRE JOHNSTONE on Thursday, 21 March 2013, 12:35 PM )

Initially Chi et al. (2008) investigated her active/constructive/interactive hypothesis in a pilot study where those participants who were observing and listening to a tutor where expected to explain what they were doing as they carried out the assigned task. They found that there was no significant difference in performance of the task between those participants who had a tutor present with them during the process and those who simply watched, listened and explained the task.

Next, Chi et al. (2008) tested the active/constructive/interactive hypothesis by setting up another experiment where participants were separated into five different learning environments. Their assigned task was to complete a variety of physics problems. Participants completed a physics pre-test and a post-test whereby results were compared for each condition. The conditions were as follows:

· the 
tutoring group (participants who had a tutor present in the room with them 
 that they could speak with)

· the 
collaborative observers (participants who watched and listened to the 
 tutoring session video while discussing with their partner how to solve each problem)

· the 
collaborators (participants who were not allowed to view the tutoring video 
 however were given a textbook to help with answering the questions whilst interacting with each other)

· the lone 
observers (participants who watched the tutoring session and completed the 
  problems by themselves)
· the studying alone (participants who did not view the tutoring session who answered the questions by themselves with only the help of a textbook)

The tutees, the collaborative observers and the collaborators all performed significantly better than the lone observers and studying alone participants.

The active/constructive/interactive hypothesis was supported since those who were in the collaborative observers condition performed just as well as those who were in the tutoring group. Chi et al. (2008) proposed that having a peer to talk to about learning material was just as effective as speaking to a tutor. Furthermore, those who observed the tutoring session with their peers outperformed those who observed the session alone therefore providing further evidence that interaction is the key to effective learning.

Those participants who interacted well in the observing collaboratively condition learned more than those who hardly spoke while those lone observers who actively engaged in the task outperformed those who observed alone without any engagement i.e. never spoke the problems out loud to themselves.

Overall, Chi et al. (2008) reported the four above findings as evidence to support the active/constructive/interactive hypothesis which leans towards the idea that interaction improves the quality and quantity of learning which occurs in students. Plus, interaction to enhance learning does not necessarily have to occur with a tutor but can be between peers.   


Critiquing the work of Chi and colleagues:


Things which have been overlooked in this paper and should be considered when conducting further research in this area:

  • Do gender, age, relationship between collaborators, and group-size have an impact on the efficacy of the program?

  • Would people suffering from Asperger's or ADHD benefit as much from this method? (These disorders could impact upon the social interaction element of the program.)


Relating the evidence to real life


 This paper is able to make conclusions that if used to good effect could have great implications in all of education not just HE. It seems like the obvious progression is, that if groups of students learn just as well observing a tutorial of good students then this could very easily be produced on a larger scale. With so many students going to university and this number increasing, this shows that there is no further need for employing extra tutors to aid students, instead it is possible to have one tutorial which is watched by all the other students in small groups. This way it would be possible to have the peer interaction, which is needed for learning, and not have as many academics employed, this could act as an opportunity to reduce fee’s as well.


Equally another way that this is related to life, is in a classroom environment. The conclusions of Chi et al (2008) show that interactions between a single student and a teacher in school is not just benefitting the student within the conversation but is also benefitting any observing student, showing that not just the active participants in class are learning to their potential.


Further benefits of the paper are to do with the conclusion that it is just ‘interaction’, not necessarily tutor interaction that is key to learning. This means that some of the best help that single tutors with a large group can give to their students would be to put the students in groups and get them to talk about the topic, this give the students the interaction needed to aid learning.



Conclusions


Two of the main goals of Chi et al (2008) paper was to design a new way of tutoring that could be easily scaled up and adapted for a number of higher education opportunities and to further their understanding of tutoring effectiveness.


The initial results that human tutoring was the most effective was not surprising, however the following results which were found were more interesting. Collaborative observation of human tutoring learned just as effectively and in fact when they observed the tutoring of competent students the observers learning was totally equivalent (if not higher). This in Chi’s opinion may show that it is ‘interaction’ that accounts for learning gains, whether that be with peers or with a human tutor.


They were able to accept their active/constructive/interactive observing hypothesis in four ways. First the Collaborative Observers were able to learn as well as the students being actively tutored suggests that it is the interactions of the observers that are important. Secondly, the fact that the more interactive the Collaborating Observers were with each other, the more they learned lends itself to support the hypothesis. Thirdly, observing collaboratively and observing alone were both manipulated and the collaborative learners learned more thus furthering their confidence in the hypothesis. Finally, Lone Observers were put into 2 groups those who were active and those who were passive and it was found that the active Lone Observers learned more than the more passive Lone Observers, again confirming the Chi et al hypothesis.


The second goal of the experiment to further their understanding of tutoring effectiveness. They found that the tutor contributes more by scaffolding the tutees than by explaining to them. This is due to the fact that scaffolding enables the students to jointly construct follow up responses, thus supporting the interactive coordination hypothesis. Chi et al also found that the tutors feedback to errors was harmful to the poor tutees and their observers, this is consistent with the interpretation that poor tutees found the feedback confusing, in part because the tutor gave them more corrective than elaborative feedback. Thus, it is not the feedback per se that determined the tutees’ learning but whether the tutees could make sense of the feedback and what kind of feedback the tutor was more likely to give. 


Whilst looking at the effectiveness of the tutors and how that affects learning it was found that, in support of other papers such as Chi et al., 2001, there was no evidence of learning from considering the tutor’s contributions alone, although some methods were slightly better than others, for example where scaffolding was used. The data, in fact, further supports the contributions of the tutees themselves, and their interactions with the tutor, as responsible for learning.


The final conclusions made by Chi et al (2008) were that students can learn by observing tutoring vicariously, showing that interactions between a teacher and student can be as important for others in the class not just the student within the interaction. The authors agree with Rogoff and colleagues that learning through observation is a valuable but often overlooked practice in mainstream schooling. Finally, the findings that observers tend to learn in dialogues that involve the tutees emphasize the importance of learning from peers, from both teaching a peer (Roscoe & Chi, 2007) as well as receiving comments and questions from a peer (Roscoe & Chi, in press).


Relating the paper to 5 Other Course Topics


Links well to:


Draper (2009) – Both talk about feedback, Draper talks about improving feedback and how and why feedback can be constructive. On the other side Chi talks about Anti-feedback and how she has shown that whenever the tutor gives feedback in the normal sense of the term: telling them where they went wrong and what they should have done, learning is reduced.

Constructivism / Social Constructivism – Although Chi doesn’t use the term much in this paper, a lot of her work has been on what could be seen as constructivism, i.e. the benefit to learning of getting learners to produce explanations for themselves.


The importance, or lack of it, of a teacher – Chi et al (2008) shows that Collaborative observation of human tutoring learned just as effectively and in fact when they observed the tutoring of competent students the observers learning is totally equivalent (if not higher).


Interaction – Chi et al (2008) shows how interaction is the key to learning, and that this can be peer interaction or tutor interaction but both can be as effective as each other.


Learning as Participation (not Acquisition) – Chi shows this by putting Lone Observers into 2 groups, those who were active and those who were passive and it was found that the active Lone Observers learned more than the more passive Lone Observers.




Additional References:


Bloom, B. S. (1984). The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as one-to-one Tutoring. Educational Researcher. 13(6): 4-16. 




Chi, M. T. H., Roy, M. & Hausmann, R. G. H. (2008) Observing Tutorial Dialogues Collaboratively: Insights About Human Tutoring Effectiveness From Vicarious Learning. Cognitive Science. 32: 301-341.


Chi, M. T. H., Siler, S., Jeong, H., Yamauchi, T., & Hausmann, R. (2001). Learning from human tutoring. Cognitive Science, 25, 471–534.



Rogoff, B., Paradise, R., Arauz, R. M., Correa-Chavez, M., & Angelillo, C. (2003). Firsthand learning though intent participation. Annual Review of Psychology, 54, 175–203.



Roscoe, R., & Chi, M. (2007). Understanding tutor learning: Knowledge-building and knowledge-telling in peer tutors’ explanations and questions. Review of Educational Research, 77, 534–574.




Roscoe, R., & Chi, M. (in press). Tutor learning: The role of explaining and responding to questions. InstructionalScience.