Web site logical path: [www.psy.gla.ac.uk] [~steve] [best]

Compilation (for printing) of pages on best principles and thoughts

This compilation was assembled on 16 May 2012.

Last changed 2 April 2012 ............... Length about 500 words (6,000 bytes).
(Document started on 15 Mar 2004.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/index.html. You may copy it. How to refer to it.

Thoughts and principles: often claiming to be THE 3 rules for something

By Steve Draper,   Department of Psychology,   University of Glasgow.

This is the entry and index page for a new wee project of mine: collecting sets of principles or best points about things, mainly educational things. A single combined page for convenient printing is here.

Good

  • Laurillard's 12 activities for learning/teaching
  • Rowntree's 17 proposals for better HE assessment
  • Bloom's taxonomy. And whose you should use instead.

  • Most favourite papers

    To be considered

  • Activism: the connection between doing and learning
  • The three types of knowledge in chemistry
  • The cost-quality triangle / quadrilateral
  • Roy Tasker's hierarchy of learning and objects
  • The three underlying causes of learning
  • The three unrelated tasks of teaching
  • Curriculum and syllabus
  • triad 1: The three parts of learning a new practice
  • triad 2: See one, do one, teach one
  • triad 3: Reading, discussing, writing
  • Teaching and learning: their nature in pictures
  • A rare example when pictures actually are worth more than words
  • Quantitative vs. Qualitative

  • 7 principles for good practice in undergraduate education (Chickering & Gamson)
  • 7 principles of good feedback practice (Nicol)     Gibbs' 4 more conditions
  • N.B. a page collecting rival sets of principles related to assessment and feedback
  • 12 principles by Romer for quality in undergraduate education
  • IUPUI (Indiana / Purdue) 6 principles of undergraduate learning (actually, learning aims, not methods for promoting learning).
  • 4 top principles by Brenda Smith for quality in undergraduate education
  • FoxFire: 11 core practices for active learning
  • 9? Alex Johnstone
  • General educational rules
  • VLEs: best and worst features
  • Informal learning
  • Creativity

  • Educational jokes
  • Thoughts for the day

    Miscellaneous

  • Interactive periodic table
  • Scale of everything
  • Gibson, Affordance, my points
  • How many senses do humans have? (Olfaction)
  • 14 basic points about colour
  • Positive psychology, public mental health
  • Patient experience, medical education, public health
  • S-shaped curve for uptake of innovations
  • Wisdom
  • Correlation and causation
  • Effect size
  • Stats Jokes
  • Proving there really is no difference
  • The best online medical advice
  • The pros and cons of making mistakes

    Small rather than best, notes

  • Web2.0
  • wikipedia
  • Answer Gardens mark 2
  • Dimensions and senses of Reflection
  • 5/12 stages/steps
  • PDP e-portfolios: This page has been replaced by: this one

    Bad

  • Anti-best: 50 poor theories of learning

  • Dale's cone

  • newPage


    Last changed 18 Feb 2005 ............... Length about 900 words (3,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/activism.html. You may copy it. How to refer to it.

    The connection between doing and learning

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    "Tell me and I forget. Show me and I remember. Involve me and I understand."
    Variously attributed to: Aristotle; Confucius; Native american proverb; Chinese proverb; Voltaire; Association For Experiential Education.

    A Chinese Proverb on Education as interpreted by Ochiai, El-Ichiro (1993) "Ideas of equality and ratio: Mathematical basics for chemistry and the fallacy of unitary conversion" Journal of Chemical Education vol.70, no.1 p.44-46

    Doing and learning: activism
    L-principle (public/private)
    My MinMan chapter
    Primary shcools and busy work
    What kind of activity? mental? varied? ...
    
    chemistry: not 2 but 3 kinds here?
    
    So what is the deep principle here?
    a) Deep learning and mulitple types of link?
    b) Specially public/private concept names <-> personal perceptual stuff
    c) Mental (re)processing: not just one task but several
    
    Deeper view: LBE vs. narrative
    
    Surgery: see one, do one, teach one.
    
    Confucius is the Latin form of K'ung-Fu-tze. Lived 550BC - 478BC or 551-479BC in /near Shantung: a contemporary of Buddha, 100 years before Plato. According to the library, actually said (after translation) "By three methods we may learn wisdom: First, by reflection, which is noblest; Second, by imitation, which is easiest; and third by experience, which is the bitterest." I.e. commenting on thinking, seeing, trial and error; but not on being lectured.

    Is said to have said -- but I haven't been able to find any reputable source for this and it isn't in the translations of Confucius in our library -- "Tell me and I will forget, show me and I'll remember, I do and I ... ".

    This at least shows that people have noticed and commented on a connection between doing and learning for a very long time. However we still don't have a clear summary or analysis of the connection.


    Last changed 23 Feb 2008 ............... Length about 700 words (5,000 bytes).
    (Document started on 8 Apr 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/alex.html. You may copy it. How to refer to it.

    The three types of knowledge in chemistry

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Alex Johnstone (see references below) pointed out that in Chemistry, students must learn in three different representations at once, and how to inter-relate each new concept or fact in all three domains:

    1. Macroscopic: descriptive and functional (e.g. how chemical phenomena appear to the senses, colour, smell, density, etc.).
    2. Formal or representational (the equations used to represent reactions).
    3. Molecular, "submicro", explanatory: the invisible but 3-dimensional world of molecules' shapes and their dynamic motions, interactions, and kinetics.

    There are several points about this.

    References

    A.H. Johnstone (1982) "Macro- and microchemistry" School Science Review vol.64 pp.377-379

    A.H. Johnstone (1991) "Why is Science Difficult to Learn? Things are Seldom What They Seem" Journal of Computer Assisted Learning vol.7, 75-83.

    A.H. Johnstone (1993) "The development of chemistry teaching" Journal of Chemical Education vol.70 no.9 pp.701-705


    Last changed 30 Oct 2007 ............... Length about 2,000 words (17,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/tasker.html. You may copy it. How to refer to it.

    The real educational issues of learning objects

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Definitions

    I first encountered the distinctions made here in a brief mention in a talk by Roy Tasker. He tells me that in fact they came from discussions at ASCILITE 2002 (the Australasian educational technology conference). Almost certainly, different people have somewhat different definitions: this is my own development of the basic idea.

    The common overall point, however, is to remind us how little the technology itself does in determining whether any learning in fact occurs.

    Examples

    I'm going to give examples not only of digital cases of each of the 4 levels, but also of text and of physical teaching materials.

    Digital asset

  • a videotape
  • a multimedia file
  • an executable physics simulation program
  • In a 3D modelling package, models of a pile of cardboard squares, each a different uniform shade of colour.
    Non-digital cases:
  • The main (expository) text in a textbook.
  • A French-English dictionary
  • The text of Middlemarch (by George Eliot)
  • The chemical sodium bicarbonate
  • A stopwatch.
  • The transcript or tape of a lecture
  • A pile of cardboard squares, each a different uniform shade of colour

    Learning object

  • A modern textbook as sold: not only the exposition, but contents, index, exercises, the covers to protect it and label it, page numbers and a binding to allow rapid flipping through it. Note that in normal life, a textbook is used for a number of different tasks, supported by different features of this object: flipping through it in a shop deciding whether to buy it, learning from it the first time, revising from it, using it as a reference source to look up specific things years later, etc. These multiple learner tasks applied to a single asset are a crucial reason for distinguishing asset from object. Typically modern digital learning objects are much poorer at this than modern printed text books, which have evolved steadily for centuries to serve more and more purposes (learner tasks).
  • A printed copy of Pride and Prejudice (by Jane Austen): either a good read for pleasure or a set book in a Literature course. Modern novels come as themselves; "classic" novels usually come with an "introduction": an essay by a scholar other than the author.
  • Copper sulfate (blue crystals): as a chemical supply; or in suitable small packaged quantities for 100 chemistry students to do a lab exercise with, complete with a label suitable for the students.
  • Sodium bicarbonate: packed and labelled for home cooking; for student chemistry experiments; ..
  • The physics simulation program with some information on what machines it will run on, and what courses it might fit into.
  • A lecture: often their purpose or role ("metadata") are announced orally and/or in handbooks e.g. "Attend if you need revision on ...", "will serve as an introduction to the reading", "essential as it contains material not in the textbook".
  • The set of coloured tiles, plus tags saying a large table top is required, and a tutor trained in their use or with the tutor script.

    Learner's activity Laurillard lists exactly 12 generic activities e.g. expression (exposition by lecture or textbook), re-expression (a student writes an essay, tries to answer a question, tries to tell another student about it), ..etc.

    Tasker's and his colleagues' idea of activity is slightly different. Examples include: Explore, Describe, Apply, Observe, Represent, Refine, Review, Access, Question, Decide, Report, Reflect, Interpret, Construct, Justify, enRole, Research, React, Resolve,

    The simulation program plus a worksheet for students of things to run on it, settings to try, phenomena to set up and observe, ...

    Learning session Neither Tasker nor Laurillard call a lecture or tutorial or going through an online document an "activity", firstly because these are generic formats for assets (like "books" or "videos"): a specific learner task must be added to the object. Of course, skillful students (or researchers at a conference) will apply their own goals: although not always what the author intended. In particular cases however, a lecturer may tell the audience what they think the activity should be for the next bit "Now put down your pens and just think about ....". However in many cases of pedestrian practice, the actual student task in lectures is not thinking nor learning, but collecting material for later possible learning.

    Sitting down a learner with tutor and a set of coloured tiles: in one case, 10 tiles of fully saturated hues. They are asked to arrange them in any order that seems logical to them. When they finish, the tutor will ask what is the rationale for their arrangement; and (if it isn't the arrangement in fact eventually required) ask them probe question e.g. (if this learner put them in a straight line) "Could the two tiles at extreme ends from each other in fact have been placed adjacently?"

    Learning design
    Tasker's own example schemata for learning designs include:

    But a more classic design might be:

    The use of the coloured tiles (whether on a tabletop, or in a 3D digital modelling package) is part of a design where the learner is given a sequence of about 10 tasks, arranging subsets of colours and then merging arrangements, and then finally placing them on a skeleton sphere to form the Runge sphere (the hue, saturation, brightness 3D colour space).

    Commentary

    The above, in my view, is the best current expression of an old lesson that keeps having to be relearned around educational technology: it isn't the technology but the pedagogical or learning design around it that makes a difference to learning. Obviously if you are a technology enthusiast you are liable to think the technology is the essential thing, but in fact experienced teachers often fall into the same error. They see (for example) a fascinating simulation that both excites them, and perhaps teaches them some new aspect of an old topic. For instance I was once present at a demo of a simulation on Taylor series for the members of my university's maths department, and one of them commented that they had been teaching this for years, but it had made them realise something new about Taylor series. It is natural for them to want to share this with their students. Then they put the software in front of the students, and are bewildered when nothing happens in most cases. The teachers have a whole "context" of partial knowledge in their heads, and for them the simulation (the digital asset) alone can be enough for a rich learning enhancement experience. But most students do not have that context: that is why they are students. When Papert and his associates were at the height of "pushing" LOGO as a programming language for children, with huge claims about the educational benefits, they talked about "the blank screen phenomenon" of how nothing happened if a child is just given LOGO by itself. My own weakness of this kind is more to do with diagrams: for the most important ideas I find or develop, I often end up creating a diagram that for me summarises it all (Laurillard's model; learning causes); but my painful experience is that these mean little to students being introduced to the ideas. At best they become useful later, but are useless for introductions.

    Pulling this together: it constitutes in another form the more abstract theoretical point that the learners who do best are generally those who already know the most, using their partial knowledge to gain access to the meaning of new material, and their stock of open questions to direct what they want to learn from it. An expert sees what is interesting where a layperson notices nothing. Having said that, the best interactive museum exhibits succeed in drawing in a wide variety of people: but these are rare.

    Tasker's 4-way distinction first makes the point that technology alone causes no learning. Secondly, it offers a first way to break down the extra work that needs to be done, and so makes a start at planning for it by giving a framework for understanding what needs to be added to naked technology or media. As I say, it is a lesson that has been painfully rediscovered again and again. Tasker's is the clearest and furthest developed statement of this core point that I have come across.

    See also Barney Dalgarno paper


    Roy Tasker

    I don't know Roy well, but I think his work is notable. Below are some pointers to him and his work. Here is some context.

    A starting motivation for him was Alex Johnstone's identification of a key bottleneck for students learning chemistry: learning in three different representations at once and how to inter-relate each new concept or fact in all three domains: the macroscopic (e.g. how chemical phenomena appear to the senses, colour, smell, etc.); the formal or representational (the equations used to represent reactions); and the "submicro": the invisible but 3-dimensional world of molecule's shapes and their dynamic motions, interactions, and kinetics. The third of these is generally the hardest for students, and least well dealt with in teaching.

    This identified a strategic educational problem in chemistry, and Roy took it on. His key idea for a solution was to develop computer animations that can show the shapes and motions of molecules, together with skilled tutorial dialogue to get students to see the problems with their assumptions and prior conceptions for which the animations offered insight.

    The "patter" that came with the computer animations is actually highly skilled socratic dialogue. For me the demo Roy once gave me in 1993? was a notable learning experience, and an exemplar I have always remembered about a mode of learning. I currently am involved in a project that in my mind was inspired by this, although in a very different area (colour theory): creating an effective learning experience around visual exercises and demonstrations, and socratic dialogue from a human tutor that guides the learner into recognising and confronting latent problems in their pre-existing partial knowledge.

    But personal human 1:1 tuition isn't cost sustainable. So Roy had two aims for the next decade of work: more simulations and animations (generalising his early exemplars to cover more of chemistry teaching); and how to replace himself as part of the package. His distinctions above reflect part of his growing analysis and understanding of what he was value-adding to the software itself.

    There is a recent PhD thesis supervised by him on this stuff:
    Rebecca Dalton (2003) The development of students' mental models of chemical substances and processes at the molecular level (University of Western Sydney). Available online: type in "Dalton" in the author box.

    Pointers to Roy Tasker

  • Home page/profile
  • Learning designs web site
  • Publisher demos on the web

    Another set of distinctions

    Simulations. animations (demonstrations); models.

    This area (of using computer animations to teach aspects of science) can raise the need for another set of distinctions e.g. between animations and simulations. A rough go at these might be:

    Having said that, every simulation is only realistic about some properties, and not others that it doesn't attempt to model.


    Last changed 15 March 2005 ............... Length about 900 words (4,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/maincauses.html. You may copy it. How to refer to it.

    Three main causes of learning

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Most work on new ways of teaching or boosting learning fails to control for really basic causes. In one way this doesn't matter: from the practical viewpoint of helping learners and increasing learning it doesn't matter whether you fool yourself or even fool the learners. But from the viewpoint of improving theory we would like to know what the real underlying causes are. Three keep recurring. The point is that so very many "new" ideas and methods cause one of these to increase. And very, very few tests or evaluations of ideas control for these.

    1. Time on task, the amount of time spent by the learner on learning.
      Perhaps that should be refined to time on actual mental processing (not just time in the classroom, or time spent moving the eyes over text without thinking, or time spent taking dictation).

    2. Mental reprocessing: more particularly, the number of different types of reprocessing. I.e. of using the "knowledge" in a different way than the one it was first received in. E.g. if teacher told you, then re-telling it (to a peer, in an essay) or using it to do a textbook problem.

    3. Recognising that you (the learner) are wrong and/or don't know this point. Getting the learner to commit to a false view, and then to confront the fact they got it wrong or didn't know the answer. These may really all be aspects of the "metacognition" point that realising you don't know something is an important cause of learning. What is deadly (suppresses learning) is the feeling that you knew that, already know that. So part of this is getting the learner to commit to something, preferably in front of others but certainly in a way they have to admit to themselves e.g. writing down an answer.
      A major aspect of this, is "brain teasers": of skilled teachers (or textbook authors) coming up with questions that are NOT difficult, but tempt many learners into overt error. The issue here is connecting the new knowledge to old ways of thinking that are in fact partly wrong, and must be worked over actively by the learner. Telling people just to forget something never works: erasing takes much more work than simply taking something new.
      The best theoretical label for this recurrent theme may be "accommodation" (as opposed to assimilation); or "prior misconceptions"; or "phenomenography" which is the name of a technique and research approach for discovering how learners experience, think about, and misunderstand topics.


    Last changed 3 April 2010 ............... Length about 300 words (3,000 bytes).
    (Document started on 10 Mar 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/chickering.html. You may copy it. How to refer to it.

    Chickering and Gamson's 7 principles for good practice in undergraduate education

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Arthur W. Chickering and Zelda F. Gamson (1987) "Seven principles for good practice in undergraduate education" American Association of Higher Education Bulletin vol.39 no.7 pp.3-7   Online version

    These seven principles are widely respected at least in the USA. Note that they all can all be applied to assessment, not just to wider aspects of education. Here they are in brief (see links below for exposition).

    1. Encourages contacts between students and faculty.
    2. Develops reciprocity and cooperation among students.
    3. Uses active learning techniques. (a.k.a. "Encourages active learning")
    4. Gives prompt feedback.
    5. Emphasizes time on task.
    6. Communicates high expectations.
    7. Respects diverse talents and ways of learning.

    They also list "six powerful forces in education":

    1. Activity [cf. 3]
    2. Expectations [cf. 6]
    3. Cooperation [cf. 2]
    4. Interaction [cf. 1,2,4]
    5. Diversity [cf. 7]
    6. Responsibility [cf. 6?, 5?]

    Here are some more links to them:

  • www.tltgroup.org/programs/seven.html
  • www.hcc.hawaii.edu/intranet/committees/FacDevCom/guidebk/teachtip/7princip.htm


    Last changed 29 Aug 2011   ..............   Length about 5300 words (52,000 bytes).
    (Document started on 15 Mar 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/bloom.html. You may copy it. How to refer to it.

    Taxonomies of learning aims and objectives:
    Bloom, neoBloom, and criticisms

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Bloom's taxonomy originated in an attempt to make assessment more systematic, though it is expressed as being about different types of learning objectives. It is particularly useful, as intended, for help in designing tests e.g. MCQs (multiple choice questions), since we tend to assume that MCQs can only test rote learning, but with care you can test much "higher" kinds of learning. My own interest is in learning and teaching in HE (Higher Education). The commentaries at the end probably show that focus, and may not have the same force in relation to school (K12).

    Bloom's taxonomies have since been revised, above all by Anderson, Krathwohl et al. (hereafter "A&K"), and this page's first aim is to summarise those revisions for reference. If you are going to use Bloom's taxonomy today, you need to be aware of, and probably to use, the revised ones. However there is naturally the question of how useful such an old idea (more than 50 years old) still is, so the second aim here is to sketch an evaluation of that.

    N.B. The taxonomy is what Bloom is most often cited for; however more important for improving learning and teaching in HE is probably his Mastery Learning work.

    Part A: Summaries, pictures, references of Bloom's taxonomy and revisions to it

    Diagrams of Bloom's taxonomy

    Other web pages

  • A version of Bloom: emedia.rmit.edu.au/edmag/files/ed_magazine/Blooms_taxonomy.pdf
  • A version: http://eet.sdsu.edu/eetwiki/index.php/Blooms_taxonomy
  • A modification: http://coe.sdsu.edu/eet/Articles/bloomrev/index.htm Now vanished.
  • Improved Bloom, by Anderson & Krathwohl, see Doceo website: http://www.learningandteaching.info/learning/bloomtax.htm
  • Multiple intelligences and Bloom's taxonomy http://www.cap.nsw.edu.au/rm/s3/coral_reef/mi_blooms.doc

    Yet other pages

  • http://www.uwsp.edu/education/lwilson/curric/newtaxonomy.htm
  • http://www.wtvi.com/teks/ds/images/bloom.gif
  • http://farm1.static.flickr.com/147/361710524_68e8565015.jpg
  • http://www.techdis.ac.uk/resources/files/Blooms%20taxonomy.png
  • http://www.cobbk12.org/sites/ALT/training/Blooms/circle.GIF
  • GU Guide linking Bloom levels to verbs for use in assessment definitions.

    Tables of neo-Bloom (Anderson & Krathwohl -- A&K)

    Here are tables representing the neo-Bloom taxonomy and its relationship with the original Bloom taxonomy. Some explanations appear after the tables.

    1) Multi-dimensional Bloom: domains of knowledge:
    (Levels X domains)
    level Old (Bloom) Cognitive (new, A&K) Affective Affective2 (Norman Reid) Psycho-motor Psychomotor2 (e.g. dance) Perceptual (me)
    6 Evaluation Creating - World view - Communicative movement Create complex perceptions in others
    5 Synthesis Evaluating Characterising by value or value concept Values Naturalisation Skilled moves Complex scene understanding
    4 Analysis Analysing Organising and conceptualising - Articulation Physical abilities Connoisseurship, classify perceptions
    3 Application Applying Valuing Attitudes Precision Perceptual abilities Active perceptual skills
    2 Comprehension Understanding Responding Beliefs Manipulation Fundamental movements Recognise novel cases
    1 Knowledge Remembering Receiving Knowledge Imitation Reflexes Recognise standard cases
    0 Understanding language Understanding language Feeling - Moving Moving Sensing

    2) Multi-dimensional neo-Bloom: types of knowledge
    [Levels X types, for cognitive domain only] neoBloom scheme in old Bloom table format.
    level Processes (internal, mental) Factual Conceptual Procedural (external behaviour) Metacognitive
    6 Creating Combine Plan Compose Actualise
    5 Evaluating Rank Assess Conclude Action
    4 Analysing Order Explain Differentiate Achieve
    3 Applying Classify Experiment Calculate Construct
    2 Understanding Summarise Interpret Predict Execute
    1 Remembering List Describe Tabulate Appropriate use

    3) A&K usual presentation
    of the 2 dimensions as a blank table to use in analysing a course
    Cognitive process dimension
    Increasing mental complexity of processing →
    Knowledge (type) dimension:
    increasing abstractness
    1
    Remember
    2
    Understand
    3
        Apply   
    4
      Analyse  
    5
    Evaluate
    6
      Create  
    Factual            
    Conceptual            
    Procedural            
    Metacognitive            

    4) A&K example use
    The definitions of each objective etc. for the course being analysed are normally given in footnotes or a key to the table.
    Cognitive process dimension
    Increasing mental complexity of processing →
    Knowledge (type) dimension:
    increasing abstractness
    1
    Remember
    2
    Understand
    3
        Apply   
    4
      Analyse  
    5
    Evaluate
    6
      Create  
    Factual Objective1,
    Activity1,
    Assess3
             
    Conceptual   Activity1        
    Procedural   Activity3 Objective3,
    Activity3,
    Assess1
         
    Metacognitive   Objective2,
    Activity3
           

    5) A&K filled with verb-noun phrases
    Level: 1 2 3 4 5 6
    Processes (internal, mental): Remembering Understanding Applying Analysing Evaluating Creating
    Factual Remember facts Understand facts Apply facts Analyse facts Evaluate facts Create facts
    Conceptual Remember concepts Understand concepts Apply concepts Analyse concepts Evaluate concepts Create concepts
    Procedural (external behaviour) Remember procedures Understand procedures Apply procedures Analyse procedures Evaluate procedures Create procedures
    Metacognitive Remember metacognitive items Understand metacognitive items Apply metacognitive items Analyse metacognitive items Evaluate metacognitive items Create metacognitive items

    6) A&K filled with keywords invented by others
    This is a transposed version of table 2
    Level: 1 2 3 4 5 6
    Processes (internal, mental): Remembering Understanding Applying Analysing Evaluating Creating
    Factual List Summarise Classify Order Rank Combine
    Conceptual Describe Interpret Experiment Explain Assess Plan
    Procedural (external behaviour) Tabulate Predict Calculate Differentiate Conclude Compose
    Metacognitive Appropriate use Execute Construct Achieve Action Actualise

    7) A second rendering of the same table (with colours)

    8) Definitions of processes or levels?
    -- my rationale / restatement of the levels i.e. of the first dimension
    N.B. A&K call the set of 6 levels the dimension of cognitive processes
    level Processes, internal
    A&K redefinition of Bloom levels as internal mental processes
    Procedural, external
    Examples of A&K's Procedural knowledge type (external behaviour)
    New definition (me)
    7 - - Create new categories, concepts, or rules
    6 Creating Compose Generate a new complex case from old elements
    5 Evaluating Conclude Weighted overall judgement of several given complex cases, relating elements
    4 Analysing Differentiate Break down a given complex case into known elements
    3 Applying Calculate Apply old knowledge to new cases (transfer across cases)
    2 Understanding Predict Paraphrase (transfer across descriptions)
    1 Remembering Tabulate Name, recall, and reproduce (elements, relationships)
    0 - - Understanding language

    Some explanatory points

    Graphical orientation

    Bloom's 6 levels are usually depicted as a vertical list, with the higher (more complex) levels at the top; as in the various pictures at the top of this web document. Table 1 also shows the levels in this orientation.

    A&K however show the 6 levels horizontally, with the more complex to the right. Table 3 shows them this way.

    Table 2 is intermediate: it shows the basic A&K 2-D scheme, but in the old orientation.

    The 3 dimensions

    A&K revision of the levels

    A&K slightly relabelled and reordered (swapping levels 5 and 6) the Bloom levels. The levels are shown in the old Bloom order in table 1, with the A&K relabelling also shown (in col.3) (and in table 8 in the new A&K order, with columns 2,3 showing the old and new labels).

    The A&K ordering of the levels is used in the various A&K tables above.

    The last table (8) (which uses the A&K ordering) addresses a question of the processes. The A&K labels refer to internal, mental ("cognitive") processes. There are corresponding external behavioural tasks, which are examples of A&K's "procedural knowledge type", and which you might require learners to do for instance in an assessment: shown in col.3. A longer definition of what I imagine these intellectual operations really mean is offered in the last column.

    What A&K felt they were doing

    A&K's contribution, in their own view at least, is:

    Thus A&K are fully aware that language is at best a partial clue to classifying objectives. In their main vignettes they often discuss this, and end by re-classifying an ILO from where they had first assigned it. Against this is a strong desire many of us feel to summarise every category by a single mnemonic word label -- specially useful when you are scanning a whole table trying to get an overview, to reflect on contrasts and coverage. This web page is primarily motivated by a desire to find or create such a useful visual overview, and it leads to a use of 1-word labels. This is however dangerous, problematic, and leads to many errors. A&K did NOT do this.

    Metacognition

    For A&K, the knowledge type of metacognition is not the aspect of metacognition about self-regulation, not about managing one's learning; but is knowledge about the knowledge, about managing the application of each bit of knowledge. E.g. for arithmetic division, you can divide any two numbers except you mustn't divide by zero; the part-whole skill training issue that there is extra knowledge in how to connect the parts; near and far transfer issue is that there is extra knowledge in how to apply knowledge to each new case/context.

    They subdivide it into:

    1. Strategic: tag a procedure (both thinking and learning ones) with the metacognitive knowledge that it applies more widely.
    2. About "cognitive tasks": actually about test tasks. This is probably the "rules of the game" knowledge that students must pick up in order to do well in exams. What the tasks are that are being demanded (explicitly or implicitly); which tasks are relatively easy for this particular learner and her particular talents.
    3. Self-knowledge -- a person's estimate of their own: capability (self-efficacy); intrinsic interests; valuation of each type of task.

    References


    Part B: Criticisms of these taxonomies

    Bloom's taxonomy is about different types of learning objectives. It thus belongs within the part of education that believes teaching should be organised in this way, and that the goals of teaching should be explicit. (See here for counter arguments.)

    Alex Johnstone, Norman Reid

    For a different view, partly denying that Bloom's levels form a sequence (as opposed to an unordered set) see these notes by Norman Reid.

    Johnstone's categorisation of types of problem-solving subverts it in another way. Problem-solving is close to the heart of assessment tasks in science, but instead of classifying them as a developmental sequence with 6 levels, Johnstone suggested there were 8 types (only 2 of which were widely seen in teaching), made up of all combinations of 3 binary properties: whether the data were given or incomplete; whether the outcomes or goals of the task were given or "open" (decided by the learner before or during the task); and whether the methods were familiar or unfamiliar.

    Types of problem for solving (Johnstone 1993)
    Type Data Methods Outcomes/goals Skills bonus
    1 Given Familiar Given Recall of algorithms.
    2 Given Unfamiliar Given Looking for parallels to known methods.
    3 Incomplete Familiar Given Analysis of problem to decide what further data are required. Data seeking.
    4 Incomplete Unfamiliar Given Weighing up possible methods and then deciding on data required.
    5 Given Familiar Open Decision making about appropriate goals. Exploration of knowledge networks.
    6 Given Unfamiliar Open Decisions about goals and choices of appropriate methods. Exploration of knowledge and technique networks.
    7 Incomplete Familiar Open Once goals have been specified by the student these data are seen to be incomplete.
    8 Incomplete Unfamiliar Open Suggestion of goals and methods to get there; consequent need for additional data. All of the above skills.

    Johnstone,Alex. (1993) "Introduction" in Creative problem solving in chemistry: Solving problems through effective groupwork (London: Royal Society of Chemistry)

    What are Bloom taxonomies good for?

    They can help in writing:

    It is particularly useful for help in designing MCQs (multiple choice questions), since we tend to assume that MCQs can only test rote learning, but with care, you can test much "higher" kinds of learning.

    The helpfulness is generally by associating each Bloom category with keywords and using these to prompt a teacher's imagination. This operation works with teachers who apply masses of commonsense when using the prompts. However the inverse operation works very badly: scanning text for the keywords and automatically classifying with the Bloom level, because English isn't simplistic like that.

    In fact the "level" of a question actually depends on the processing it triggers in the learner's mind, and not on the words. Brain teasers (e.g. Mazur's "ConcepTests") have the surface form of simple factual questions, but trigger deep thinking about reasons for and against.

    Better alternatives

    Other prompting schemes also work, perhaps better.

    1. One good one is to take Laurillard's 12 learning activities, and use them as a checklist for examining whether a given course supports all of them. One big hole in Bloom's scheme which this exposes is the need to get courses to connect each topic with perceptual aspects of experience (see the section on this below).

    2. Another kind of checklist is of question types. One type which I've found very useful (as do audiences whom I've addressed) is the "assertion-reason question". Another type is the brain teaser I mentioned above.

    3. I want a different hierarchy, one based on critical thinking (Perry, Kuhn):
      1. Facts (and concepts)
      2. Reasons: that make a fact more or less likely to be true. Evidence.
      3. Knowledge of alternative, rival, possible conclusions
      4. Decision on which is more likely to be right, given all the evidence available.
      There is no trace in Bloom of [2], no admission that [3] is not only possible but important, and [4] is only discussed w.r.t. finding faults in conclusions, not to addressing the making of decisions under uncertainty.

    4. Steve Brindley used the following as a checklist for teaching (for lesson plans / learning designs).
      Steve Brindley's check list for learning designs
      (brindley@physics.gla.ac.uk)
      Intellectual aims and goals Practical aims and goals Attitudes and interests
      Recall previous work Lab observations Individual / group work
      Problem recognition & awareness Record data Safety consciousness
      Problem solving Communication/ discussion Personal context
      Hypotheses, Prediction, Test Using powers of observation Practical problem solving.
      Generate ideas Using equipment Experimental learning
      Following practical instructions
      Recording facts / ideas in words
      Manipulating equipment

    Bloom level / question level / task level

    This section is unsatisfactory, and perhaps unnecessary. It would take a lot of work to properly articulate what is unsatisfactory from a modern perspective about Bloom's taxonomy. I'll just leave it in its present state.

    Bloom taxonomy levels don't really work; particularly not for classifying test questions.

    In fact the "level" of a question depends on the processing it triggers in the learner's mind, and not on the meanings of the words, let alone their surface form.

    In fact, especially in HE, each discipline typically has a core test activity type e.g. essay writing in History, problem solving using calculations in physics. These are usually a fairly good match to the Bloom level demanded, inherently requiring high level cognitive functioning; although the highest marks may require additional functioning that is not explicitly required by the question i.e. the student must know the implicit demands of the discipline (see below) e.g. whether to display originality or not, whether to redefine the exam question or whether this will be penalised.

    The fallacy of one word labels

    Most Bloom inpsired work tries to identify single word labels for each taxonomic node or concept. This is fundamentally mistaken. If we suppose (and some may very reasonably deny this) that nevertheless there is a universal taxonomy to be discovered, it is a hidden abstract one referring to mental states of the learner which cannot be directly observed. The level of a question depends on the learner's mental processing and not on a question or task in isolation. This makes a taxonomy in practice much less useful than it seems because the operationalisation of a "level" cannot be translated into a task type or question format. Teachers with a deep if implicit grasp of this can be, and often are, usefully prompted by the taxonomy. Those without cannot be helped by it.

    Here's where good examples would fit, referring to the "level of a question".
    

    Not psychomotor but sensori-motor, and above all perception

    Bloom's attention to "psychomotor" while omitting perception seems to be a blunder. Each area of study has a personal, sensori-motor aspect (too often neglected). This is expressed in Laurillard's model as the private, experiential part of learning (as opposed to the public, abstract, conceptual one). However if you have to omit one domain, then all subjects have a perceptual part, but some like astronomy or geology do not have a motor one (a physically constructive part) and are entirely descriptive (you can't build a star in the lab, but you can observe them). I.e. perception is a more nearly universal aspect of learning than movement.

    For instance: In school biology (since Bloom's time) it has become compulsory for pupils to learn to distinguish in photomicrographs and diagrams eukaryote from prokaryote cells; animal from plant cells, etc. A physician must be able to recognise a disease in a patient, not just talk about it to other medics. A student of chemistry should know what gold looks like compared to copper. These things are taught and assessed. Bloom's taxonomy misses their important place, and A&K perpetuate this major omission.

    In using a checklist to review a course's content and assessment, I would always look at what connection it makes to students' personal experience, and especially to perceptual experience and skills.

    The above are educational arguments why splitting motor from perception is a blunder. It was an old-fashioned psychological tradition to split them; but one that is regarded as wrong by some important cognitive approaches since Bloom e.g. J.J.Gibson, and work on robotics. You can't build a practicable robot by splitting them: Rodney Brooks argued and demonstrated that you have to have layers each of which have both sensning and motor action, distinguished by how fast (but stupidly) they can respond.

    The psychomotor itself

    It seems to me that there is no trustworthy treatment of (psycho)motor knowledge. Dave (1970) is widely cited, following Bloom, whose student he was. However that work does not seem easily available. As my table 1 shows, there seems little agreement between Dave's stages and Harrow's.

    My impression is that there is no good work on this domain; and that defining a domain as motor without perception is a serious error both educationally and psychologically.

    Level of education and Bloom

    Some assert that Bloom levels map to levels of certificate in education systems. This must be wrong for reasons including these:

    Disciplinarity

    The main list of Bloom levels expresses a set of values about what cognitive operations are more valuable than others. A&K have a slightly less rigid view of this, but still think there is a value ordering there. However:

    For instance, Arts schools (which at least in the UK award HE degrees), require for admission, in year 1, and in all exercises, that students exhibit different compositions from each other: i.e. they demand "creativity", the top Bloom level, pervasively. In contrast in psychology (for instance) students are drilled in an impersonal and conformist voice, not to put their own experiences forward as evidence, to produce the right answer not a creative one. Creativity is explicitly penalised.

    The old Bloom hierarchy put Evaluation at the top, above synthesis. That aligned with the view that the best paid jobs were executives, filtering what was offered by underlings to select the best things for the bosses' needs. As in the Renaissance, artists were relatively low paid employees. A more romantic view, expressed in the revised taxonomy, puts a higher value on creativity. Yet this fails to distinguish the synthesis a plumber shows (selecting a novel combination of off-the-shelf pipe and joint elements to suit a unique need) from the creativity described in product design texts, where design is not about assembling existing components, but finding a design that optimises multiple conflicting demands (that the product be cheap, be functional, be easily assembled, be easily cleaned, .....).

    In chemistry you will need to reproduce the symbol "W" for Tungsten, and paraphrasing that as "Wolfram" (which would demonstrate historical understanding) will be penalised: rote reproduction of the symbol is required. In many other disciplines however paraphrase will be a required demonstration. Not only does this show a difference in values between disciplines, but it would not be stated in test questions for chemistry: students must know this value.

    History as a discipline can usefully be considered as a training in writing "the History essay". Students will eventually be expected to take the question, redefine it (and state and justify their own redefinition), relate it to theories (probably to more than one) thus demonstrating "applying" and "analysing", and produce a weighted evalution. But they will get the highest marks by arguing a hypothesis of their own (demonstrating "creating") although it would never be called that. However in many other disciplines, this would be penalised as "not answering the question". This is not because Bloom is right and all academics across the world are wrong: it is because there are different values in different discipines, and Bloom's taxonomy does not and can not represent this.

    According to A&K, Bloom was aware that discipline area matters and said as much in writing. In that case, this criticism is not that they missed noticing the issue, but that their continued failure to address it does indeed undermine the whole enterprise.

    End summary

    What is good about Bloom's taxonomy is that it can serve as an effective prompt to teachers, to design better test questions and/or teaching.

    What is bad about it includes the points above, such as its neglect of perceptual learning, and its denial that different discipines require different kinds of thinking. And that even if the taxonomy is valid, it is a taxonomy of invisible aspects of learners' minds, and we cannot systematically and reliably translate this into question formats or other concrete teaching and learning activities.

    Its connection to improving teaching really amounts to a corrective for the pervasive tendency to design courses around "covering content", and instead prompts teachers to devote course time and effort to the mental tasks that are central to a given discipline: these are not merely higher types of cognitive processing than rote learning of answers, but more generally are what feedback and tutoring need to be concentrated on. (Content largely takes care of itself.) These are different in different disciplines, but what is common is the need to focus learning objectives, tests, and staff time on something more than reproduction of content.

    Appendix: Wanted -- killer examples of questions

    If I work further on this page, then the main thing is to generate good examples to match the plan list below, and thereby construct a demonstration of the fundamental wrongness of the Bloom taxonomic approach from a theoretical perspective (although it retains some pragmatic utility).

    Aims to fulfill

    Examples wanted

    1. A good assertion reason qu
    2. One with physics reasons but not on the course
    3. A qu. that could be physics OR other disc
    4. Antaki: types of why
    5. Aristotle: types of cause
    6. Health & Safety: types of cause
    7. wider: crystal healing, astrology
    8. Brain teaser: Mazur's ConcepTests (get real eg.s.)
    9. Brain teaser: Levis I.e. evoke strong reasoned attractions in 2 or more response items. I.e. the context of noticing internal contradiction
    10. Brain teaser: The 3 recent ones, like Levis (exp. growth, ...)
    11. (Howe) It's the context of peer challenge.

    Examples

    Molesworth jokes here.


    Last changed 3 Sept 2011 ............... Length about 2,000 words (16,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/wisdom.html. You may copy it. How to refer to it.

    Data, information, knowledge, wisdom

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    (See also the wikipedia entries on: the DIKW model and wisdom.)


    Where is the wisdom we have lost in knowledge?
    Where is the knowledge we have lost in information?
      T. S. Eliot, The Rock (1934)


    The sequence in brief:
    1. Features
    2. Data
    3. Information
    4. Knowledge
    5. Understanding
    6. Wisdom
    7. Being, transformation, enlightenment
    Another sequence, by Frank Zappa:
    1. Information
    2. Knowledge
    3. Wisdom
    4. Truth
    5. Beauty
    6. Love
    7. Music


    There is a sequence or hierarchy:

    Footnote

    BUT note that it is possible to make sense of aphorisms that imply a reverse direction e.g. "we understand more than we know". E.g. nazi citizens were not told, and did not know, about concentration camps; but may have understood something about people disappearing, .... Children may understand they shouldn't talk about some things, .... We may understand exactly what to say to calm a family member down, without knowing that we know that...

    If this means anything, it might be about: (1) (not) knowing what we know or remember cf. being surprised we can remember something. (Issues of metamemory.) (2) A facet or consequence of the way we "know" things at two or three levels, which are usually but not entirely aligned in our minds. Examples of this include a) procedural (behavioural) knowledge vs. declarative (conceptual) knowledge; b) inconsistencies (recorded in studies of science concepts in school children) between behaviour, predictions, explanations; c) Activity Theory's distinction between Activities, Actions, Operations.

    "Education makes us more stupid than the brutes. A thousand voices call to us on every hand, but our ears are stopped with wisdom." - Jean Giraudoux
    Perhaps this uses 'wisdom' in the metacognitive sense, but refers to cases where it is inaccurate.

    Belief, knowledge, thought

    The word "belief" doesn't belong in the above sequence, but is part of another set that is not really about truth in the world, but about whether the speaker is assuming or is drawing attention to how questionable an assertion is. Here I'll call the putative fact the "proposition", and the person talking or writing about it the "speaker". There is a set of cases depending on the combinations of whether the proposition is presupposed true or is in question; and whether who believes it is in question or not:

    Knowledge has been defined as true, justified, belief. But in actual English usage, from a Socratic perspective, and from a child development viewpoint, this is back to front. We say we know something when we hold a proposition we believe is true but are not thinking of any grounding or warrant for it. When its truth is in doubt, then we mark this by saying "believe": in ordinary discourse, we only say we "believe" something if we want to draw attention to the idea that it may be false, whereas if we are just taking something as given, we say "know". A very young child cannot grasp that other people may not know the same things as they do: when they start to be able to handle this, then we talk of them having acquired a "theory of mind"; i.e. of tagging things they know according to who else knows or believes them. It is sometimes claimed that those suffering from autism cannot do this (they can only know, not believe). In fact, to say we believe something is to say we are holding in mind a proposition whose truth or falsity we are able to reason about. In other words, we are able to think critically about it. This is knowledge plus doubt; and is more advanced than simply relying on propositions we are unable to question.

    In general, then, "belief" marks going one step beyond knowledge, to a "theory of mind", "truth maintainence system", "reason maintainence system", "critical thinking". That is, not simply remembering facts i.e. what is true, but the reasons for believing it and/or who believes it.

    In what way(s) does this matter?

    At the simplest level, this topic is just about pondering distinctions between similar words, and wondering if there are important conceptual distinctions hiding there. Whether there are different kinds of knowledge or knowing hiding here.

    However for me, this began with reading Dretske's book on what information was. The enduring point this left me with, was that the technical definitions of information (important in computing and in physics) particularly in communication are dependent on a pre-existing knowledge. Dots and dashes only mean something when sender and receiver have pre-agreed that they are using Morse code, and so on. So information is useless, or rather non-existent, without prior knowledge of the alternatives and of how these differences appear in the data.

    If we consider the progression of stages data → information → knowledge → ... from left to right, then the right hand stage at each step extracts new value from the left, but only by virtue of assuming another kind of thing in advance. Essentially, then, the flavour of all the earlier steps in this progression is of building certainty from empirical sense data; a model of perception; "bottom up" construction. Yet it depends on pre-existing certainties, presupposed true but/and not tested or learned by the left to right flow. In this way the assumptions are like the knowledge vs. belief distinction: stances about what is being assumed at a given moment, rather than any absolute status.

    There is a converse to this: whenever you have to learn not a new item, but a new field e.g. when you switch research fields or start learning a completely new subject, then what you as a learner most needs is a working set (however simplified) of these assumptions without which little can be done. This is a top down direction of travel or priority; and is one way of explaining the importance of teachers: not to communicate lots of data, but to install assumptions that allow learning to begin, and to progress efficiently. E.g. "don't run before you can walk", "don't bother looking at X it's beside the point", ... Installing these assumptions in a learner equips them, not with conclusions, but with the means to interpret and so self-teach the area.


    Last changed 5 Jul 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 5 Jul 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/aahe.html. You may copy it. How to refer to it.

    9 Principles of Good Practice for Assessing Student Learning

    By Steve Draper,   Department of Psychology,   University of Glasgow.

  • http://www.higher-ed.org/resources/assessment-AAHE.htm


    Last changed 12 Sep 2006 ............... Length about 600 words (5,000 bytes).
    (Document started on 10 Sep 2006.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/ag2.html. You may copy it. How to refer to it.

    Answer gardens mark 2

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Ackerman's idea of an answer garden is to grow an FAQ through (social) interaction. The administrator creates (and periodically must re-design) a taxonomy tree for the area. The user with a query navigates the tree trying to home in on an answer to their question. Either they find a tip/leaf with the answer, or at that tip they post their question. An expert is associated with each subtree, and receives any query posted within it. They reply, and their answer goes both by email to the questioner, and on to the tree for future users.

    Sloep's idea is that the user with a question simply expresses it in free text. Software analyses it using "latent semantic analysis" (similar to the full text indexing behind search engines) and matches it to stored library of documents (explained in a moment). The output will be not an answer but a new wiki, seeded with the question, with members consisting of the questioner plus a small number of senior students. The latter have been picked by looking at their records for courses they have done, and machine analysis of documents associated with the course contents. Perhaps, plus information about whether they are online at the moment, if there are lots of students, and to give it an "instant messaging" aspect. (Actually, they have more sophisticated ideas than this: see Kester et al., 2006.)

    There are a million variations one can think of.
    Terry Mayes suggests that the wiki itself is a documentary trace that can be the basis of awarding marks to contributing students: it shows and measures engagement. Students volunteering could write a short piece about what they had found most interesting about the course, which would be one of the documents feeding into the LSA. Could seed the wiki not only with the question, but with the wikipedia (or other web search) entry.

    However the full web2.0 spirit suggests that this idea will work much better with a huge population, not a small isolated course. And that it will be much more appealing to questioners if the response is more or less immediate, which again suggests a huge population and using "being online" as a selection mechanism. It means then that the mechanism could satisfy Illich's vision of learning as depending on an instant ad hoc community (for learning), not some geographical or institutional one. Anyone learning about anything could post a query and find just a handful of people able, willing, and available to chat about it.

    Might be worth trying on big first year courses. We have 600 in our psychology level 1 classes. That means there are about 1800 students at the university who did that course in the past, and might have an impulse to answer a few simple questions now and then.

    References

    Ackerman,M.S. & Malone,T.W. (1990) "Answer Garden: A tool for growing organizational memory" Proc ACM conference on office information systems pp.31-39

    Ackerman,M.S. & McDonald,D.W. (1996) "Answer Garden 2: merging organizational memory with collaborative help" Proc CSCW'96 pp.97-105

    Ackerman,M.S. & Palen,L. (1996) "The Zephyr help instance: promoting ongoing activity in a CSCW system" Proc CHI'96 pp.268-275

    Liesbeth Kester, Peter van Rosmalen, Peter Sloep, Francis Brouns, Malik Kon & Rob Koper (2006) Matchmaking in Learning Networks: Bringing Learners Together for Knowledge Sharing


    This compilation assembled on 29 Mar 2005 .


    Last changed 15 March 2005 ............... Length about 300 words (3,000 bytes).
    (Document started on 15 Mar 2004.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/index.html. You may copy it. How to refer to it.

    Thoughts and principles: often claiming to be THE 3 rules for something

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    This is the entry and index page for a new wee project of mine: collecting sets of principles or best points about things, mainly educational things. A single combined page for convenient printing is here.

    Good

  • Laurillard's 12 activities for learning/teaching

    To be considered

  • Activism: the connection between doing and learning
  • Roy Tasker's hierarchy of learning and objects
  • The three underlying causes of learning
  • Teaching and learning in pictures

  • 7 principles for good practice in undergraduate education
  • FoxFire: 11 core practices for active learning
  • 9? Alex Johnstone
  • newPage
  • newPage

    Bad

  • Anti-best: 50 poor theories of learning
  • Bloom's taxonomy. And whose you should use instead.

    Miscellaneous

  • S-shaped curve for uptake of innovations
  • Wisdom
  • Correlation and causation
  • Proving there really is no difference


    Last changed 18 Feb 2005 ............... Length about 900 words (3,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/activism.html. You may copy it. How to refer to it.

    The connection between doing and learning

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    "Tell me and I forget. Show me and I remember. Involve me and I understand."
    Variously attributed to: Aristotle; Confucius; Native american proverb; Chinese proverb; Voltaire; Association For Experiential Education.

    A Chinese Proverb on Education as interpreted by Ochiai, El-Ichiro (1993) "Ideas of equality and ratio: Mathematical basics for chemistry and the fallacy of unitary conversion" Journal of Chemical Education vol.70, no.1 p.44-46

    Doing and learning: activism
    L-principle (public/private)
    My MinMan chapter
    Primary shcools and busy work
    What kind of activity? mental? varied? ...
    
    chemistry: not 2 but 3 kinds here?
    
    So what is the deep principle here?
    a) Deep learning and mulitple types of link?
    b) Specially public/private concept names <-> personal perceptual stuff
    c) Mental (re)processing: not just one task but several
    
    Deeper view: LBE vs. narrative
    
    Surgery: see one, do one, teach one.
    
    Confucius is the Latin form of K'ung-Fu-tze. Lived 550BC - 478BC or 551-479BC in /near Shantung: a contemporary of Buddha, 100 years before Plato. According to the library, actually said (after translation) "By three methods we may learn wisdom: First, by reflection, which is noblest; Second, by imitation, which is easiest; and third by experience, which is the bitterest." I.e. commenting on thinking, seeing, trial and error; but not on being lectured.

    Is said to have said -- but I haven't been able to find any reputable source for this and it isn't in the translations of Confucius in our library -- "Tell me and I will forget, show me and I'll remember, I do and I ... ".

    This at least shows that people have noticed and commented on a connection between doing and learning for a very long time. However we still don't have a clear summary or analysis of the connection.


    Last changed 29 March 2005 ............... Length about 1,000 words (8,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/tasker.html. You may copy it. How to refer to it.

    The real educational issues of learning objects

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Definitions

    Roy Tasker makes the following distinctions. They remind us how little the technology itself does in determining whether any learning in fact occurs.

    Examples

    Digital asset

  • a videotape
  • a multimedia file

    Learning object

  • A printed copy of Middlemarch (by George Eliot): either a good read for pleasure or a set book in a Literature course. Modern novels come as themselves; "classic" novels usually come with an "introduction": an essay by a scholar other than the author.
  • Copper sulfate (blue crystals): as a chemical supply; or in suitable small packaged quantities for 100 chemistry students to do a lab exercise with, complete with a label suitable for the students.
  • Sodium bicarbonate: supply; kitchen; student expt; ..

    Learning activity Laurillard lists exactly 12 generic activities e.g. expression (exposition by lecture or textbook), re-expression (a student writes and essay, tries to answer a question, tries to tell another student about it), ..etc.

    Tasker's idea of activity is different. Examples include: Explore, Describe, Apply, Observe, Represent, Refine, Review, Access, Question, Decide, Report, Reflect, Interpret, Construct, Justify, enRole, Research, React, Resolve,

    Neither call a lecture or tutorial or sitting through an online document an "activity".

    Learning design
    Roy's own example schemata for learning designs include:

    But a more classic design might be:

    Commentary

    The above, in my view, is the best current expression of an old lesson that keeps having to be relearned around educational technology: it isn't the technology but the pedagogical or learning design around it. Obviously if you are a technology enthusiast you are liable to think the technology is the essential thing, but in fact experienced teachers often fall into the same error. They see (for example) a fascinating simulation that both excites them, and perhaps teaches them some new aspect of an old topic. For instance I was once present at a demo of a simulation on Taylor series for the members of my university's maths department, and one of them commented that they had been teaching this for years, but it had made them realise something new about Taylor series. It is natural for them to want to share this with their students. Then they put the software in front of the students, and are bewildered when nothing happens in most cases. The teachers have a whole "context" of partial knowledge in their heads, and for them the simulation (the digital asset) alone can be enough for a rich learning enhancement experience. But most students do not have that context: that is why they are students. When Papert and his associates were at the height of "pushing" LOGO as a programming language for children, with huge claims about the educational benefits, they talked about "the blank screen phenomenon" of how nothing happened if a child is just given LOGO by itself. My own weakness of this kind is more to do with diagrams: for the most important ideas I find or develop, I often end up creating a diagram that for me summarises it all (L-model; learning causes); but my painful experience is that these mean little to students being introduced to the ideas. At best they become useful later, but are useless for introductions.

    The above is a framework for understanding what needs to be added to naked technology or media. As I say, it is a lesson that has been painfully rediscovered again and again. Tasker's is the clearest and furthest developed statement of this core point that I have come across.

    Roy Tasker

    I don't know Roy well, but I think his work is notable. Below are some pointers to him and it. Here is some context.

    Alex' paper. xref. state it here and there.
    A key educ problem. What could be done about it?

    Simulations.

    The "patter" that came with it: actually highly skilled socratic dialogue. For me the demo was a notable learning experience, and an exemplar I have always remembered about a mode of learning. I currently am involved in a project that in my mind was inspired by this, although in a very different area (colour theory): creating an effective learning experience around visual exercises and demonstrations, and socratic dialogue from a human tutor that guides the learner into recognising and confronting latent problems in their pre-existing partial knowledge.

    But personal human 1:1 tuition isn't cost sustainable. So Roy had two aims for the next decade of work: more simulations and animations (generalising his early exemplars to cover more of chemistry teaching); and how to replace himself as part of the package. His distinctions above reflect part of his growing analysis and understanding of what he was value-adding to the software itself.

    Pointers to Roy Tasker

  • Home page/profile
  • Learning designs web site
  • Publisher demos on the web


    Last changed 15 March 2005 ............... Length about 900 words (4,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/maincauses.html. You may copy it. How to refer to it.

    Three main causes of learning

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Most work on new ways of teaching or boosting learning fails to control for really basic causes. In one way this doesn't matter: from the practical viewpoint of helping learners and increasing learning it doesn't matter whether you fool yourself or even fool the learners. But from the viewpoint of improving theory we would like to know what the real underlying causes are. Three keep recurring. The point is that so very many "new" ideas and methods cause one of these to increase. And very, very few tests or evaluations of ideas control for these.

    1. Time on task, the amount of time spent by the learner on learning.
      Perhaps that should be refined to time on actual mental processing (not just time in the classroom, or time spent moving the eyes over text without thinking, or time spent taking dictation).

    2. Mental (re)processing: more particularly, the number of different types of reprocessing. I.e. of using the "knowledge" in a different way than the one it was first received in. E.g. if teacher told you, then re-telling it (to a peer, in an essay) or using it to do a textbook problem.

    3. Recognising that you (the learner) are wrong and/or don't know this point. Getting the learner to commit to a false view, and then to confront the fact they got it wrong or didn't know the answer. These may really all be aspects of the "metacognition" point that realising you don't know something is an important cause of learning. What is deadly (suppresses learning) is the feeling that you knew that, already know that. So part of this is getting the learner to commit to something, preferably in front of others but certainly in a way they have to admit to themselves e.g. writing down an answer.
      A major aspect of this, is "brain teasers": of skilled teachers (or textbook authors) coming up with questions that are NOT difficult, but tempt many learners into overt error. The issue here is connecting the new knowledge to old ways of thinking that are in fact partly wrong, and must be worked over actively by the learner. Telling people just to forget something never works: erasing takes much more work than simply taking something new.
      The best theoretical label for this recurrent theme may be "accommodation" (as opposed to assimilation); or "prior misconceptions"; or "phenomenography" which is the name of a technique and research approach for discovering how learners experience, think about, and misunderstand topics.


    Last changed 10 Mar 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 10 Mar 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/chickering.html. You may copy it. How to refer to it.

    Chickering and Gamson's 7 principles for good practice in undergraduate education

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Arthur W. Chickering and Zelda F. Gamson (1987) "Seven principles for good practice in undergraduate education" American Association of Higher Education Bulletin pp.3-7

    These seven principles are widely respected at least in the USA. Here they are in brief (see links below for exposition).

    1. Encourages contacts between students and faculty.
    2. Develops reciprocity and cooperation among students.
    3. Uses active learning techniques.
    4. Gives prompt feedback.
    5. Emphasizes time on task.
    6. Communicates high expectations.
    7. Respects diverse talents and ways of learning.

    Here are some links to them:

  • aahebulletin.com/public/archive/sevenprinciples1987.asp
  • www.aahebulletin.com/public/archive/sevenprinciples.asp?pf=1
  • www.tltgroup.org/programs/seven.html
  • www.hcc.hawaii.edu/intranet/committees/FacDevCom/guidebk/teachtip/7princip.htm


    Last changed 15 Mar 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 15 Mar 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/bloom.html. You may copy it. How to refer to it.

    Taxonomies of learning aims and objectives

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    XXXX
    


    Last changed 16 Feb 2005 ............... Length about 500 words (4,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/wisdom.html. You may copy it. How to refer to it.

    Data, information, knowledge, wisdom

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    There is a sequence or hierarchy.


    Last changed 15 Feb 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/correlation.html. You may copy it. How to refer to it.

    Correlation and causation

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Correlation and causation.
    A -> B
    B -> A
    C -> A, B
    A <-> B, so doing either one will increase the other.
    


    Last changed 15 Feb 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/null.html. You may copy it. How to refer to it.

    Proving a real no difference

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Absence of evidence is not evidence of absence.
    
    How to show no-difference convincingly.
    


    Last changed 15 March 2005 ............... Length about 900 words (3,000 bytes).
    (Document started on 22 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/s.html. You may copy it. How to refer to it.

    S-shaped curve for uptake of innovations

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    It is often said that innovations or new practices are taken up in an S-shaped or sigmoid curve. That is, there are broadly three phases. First just a few take it up: early adopters, the first few percent, over a long slow initial period of low usage; the first low slope of slow increase, and low total use. The third phase is also a low slope and slow increase, but high total use: these are the last reluctant ones. The second, middle phase has a high slope of rapid increase.

    This view is attributed to Everett M. Rogers, and is described in his textbook "Diffusion of Innovations" (1962; 4th edition dated 1995; The Free Press; New York) e.g. ch.1 p.11 fig.1-1.

    In fact you will get a sigmoid curve for cumulative adoption if the underlying rate of new adopters (new adoption events) forms a normal distribution (and if there is no significant rate of people dropping the innovation).

    graph

    Rogers also talks of pro-innovation bias: from the tendency to study only those innovations that in fact did spread and become ubiquitous. Clearly such cases are no guide to what determines uptake in general.


    Last changed 15 March 2005 ............... Length about 200 words (3,000 bytes).
    (Document started on 21 Dec 2004.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/tandlpics.html. You may copy it. How to refer to it.

    Teaching and Learning in pictures

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    student feedback
    Generating feedback to students


    student feedback
    What course feedback from students tells you


    A rare case where pictures actually do tell a story without a single word.

    splash 1 splash 2 splash 3





    Last changed 24 Aug 2008 ............... Length about 900 words (7,000 bytes).
    (Document started on 23 Aug 2008.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/behav.html. You may copy it. How to refer to it.

    The three parts of learning a new practice

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Often in learning, you are really only learning how to talk about and reason with a new idea. However when you are learning a new approach to existing habits (e.g. a management course for managers; a slimming course for eaters; a safety course for lab technicians who have already years of experience), then there are 3 parts to the learning: getting the ideas, going over your familiar environment learning how to recognise how the ideas apply to it, going over your familiar behaviour and deciding how and when it must now be different.

    Standard impoverished HE teaching really only addresses the learning and teaching of new concepts at the public, general, abstract level. The learner, if good, will be able to recall and use the main terms, and explain what they mean in both formal and paraphrased ways; and perhaps apply them to examples of the kind dealt with in the textbooks. In some cases, this then has no impact: someone may go to such a course, but their managers may be dismayed that it has no effect on how they do their job.

    The triad

    A triad of phases of learning is what is required (spending approximately equal time on each) for learning to make a direct difference to the learner's life:
    1. Introduce (and exercise) conceptual learning, as in ordinary teaching.
    2. Have each learner then go over concrete situations they have already experienced, and learn to recognise how the taught concepts do or do not apply in each situation.
    3. Have each learner go over their normal routines and decide where, when, how to insert different behaviour into them. Where interactions with other workers are important, then how to change one's own actions in this context will also have to be addressed at length for any practical effects of the course to materialise. Food safety training in supermarkets is difficult to implement where a store is undermanned (so no time to do cleaning) and managers are under pressure to reduce food wastage (throwing away cooked food that is too old). Introducing a new accounting practice is unlikely to be something a single person can do, since accounts are the interface between many different people and unilateral changes will break communications.

    Examples

    1. Slimming. First teach concepts such as (kilo)calories. Then to recognise snacks as food as much as meals; then that all drinks except water contain calories. Then to go over one's daily eating routines and decide what to change.
    2. Bioethics. First concepts such as utilitarianism. Then go over a set of classic experimental work in biology, reviewing it for ethical issues; and ditto for applied work (in farming, in pharmaceuticals, ...). Then for actions the learner might be involved in, and when they would act e.g. in doing an experiment because the university asked them to, because a funder asked them to, jobs, ...
    3. A health and saftey course for chemistry research students. First the (legal) concepts. Then perhaps photographs of various scenes in labs, with the task of spotting what aspects of these typically very cluttered pictures violate which safety principle, if any. Then reviewing each student's actual or planned procedure for their own experiments with a view to modifying them as necessary.

    Applicability

    This triad may be least applicable to learning undergraduate subjects where the student has no existing practical experience e.g. elementary particle physics, classical literature. It will have the most applicability where the subject is practical AND the learner has already developed habits. E.g. health and safety in the lab for chemistry students, bioethics for biology students, new accountancy practices for experienced administrators, hygene (food safety) for experienced family cooks now moving into a catering job, continuing professional development (CPD) courses for teachers with years of experience, slimming or addiction personal retraining, cognitive behavioural therapy.

    The point is for any activity where we are already reasonably experienced and practised, we do not think out what we do from first principles, but rely on "habits" and practised ways of acting. Merely learning new concepts does not itself touch our behaviour nor perception. If we want the new concepts to touch our behaviour or perception, then we need to specifically exercise these in connection to the new ideas.

    An alternative triad

    The above triad is what someone designing a training course needs: three aspects, all of which need substantial time and effort from both teacher and learners. More theoretically, we might say (as Laurillard does) that all (good) teaching and learning has both abstract, general aspects and personal, practical ones; but that there are in fact three different major kinds of the latter:


    Last changed 5 Jul 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 5 Jul 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/bsmith.html. You may copy it. How to refer to it.

    Brenda Smith's 4 principles

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Brenda Smith (from the HE academy) selects these 4 from Romer's 12 principles.

    1. High expectations
    2. Emphasis on the early undergraduate years
    3. Active learning
    4. Assessment and prompt feedback


    Last changed 21 Feb 2012 ............... Length about 800 words (8,000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/correlation.html. You may copy it. How to refer to it.

    Correlation and causation

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Correlation is not causation (but it sure is a hint).

    The possible causal relationships

    Correlation and causation: if A and B are correlated, any one of these different causal relationships may underlie it:
    A ⇒ B
    B ⇒ A
    C ⇒ A, B
    A ⇔ B, so doing either one will increase the other. Bi-directional causality.
    A ≡ B. Tautology / identity. Non-causal.

    Correlation is a big hint about causality, but it is ambiguous, and mistakes are frequently made. If A is correlated with B, then all five of these relationships are equally possible, given only that evidence.

    1. A causes B
    2. B causes A
    3. A third factor C causes both A and B not necessarily at the same time (the electrical discharge of lightning causes both flash and boom, light and sound arriving at different times).
    4. A and B both increase (cause) the other, as in any positive feedback loop (vicious circle). For instance, two adjacent blocks of explosive: if one goes off, it will set off the other; if person A annoys B, B is likely to retaliate; if a student's motivation is high they are more likely to learn, but if they succeed at learning their motivation will rise (so motivation is often an effect, a symptom, not a prime mover); if A sees B as beautiful A is more likely to be attracted to B, but if A loves B then A is more likely to see B as beautiful.
    5. A ≡ B. Tautology / identity. A and B have to occur together because they turn out to be the same by definition. (See section below.)

    Caused by the same third factor

    Number 3 above may be the most troublesome.

    It is particularly misleading when the time delays involved are consistent with one direction of causality, but not the other; yet a third factor is actually prior to and causing both.

    What is also misleading is when these cases are reported with no statement about causality made, leading to almost all readers drawing the false, or at least unwarranted, conclusion the writer wanted.

    Case 1. School children who are involved with employers (e.g. in work experience) before they leave school are more likely to end up employed. (But the factors that make a child more likely to participate in these schemes may cause both participation and then success at job seeking e.g. liking work, being stimulated by environments outside the home, not having to stay home to care for relatives.)

    Case 2. Big budget movies which are promoted at the Superbowl gross about 40% more than those who don't. (But having more money for promotion predicts success; and so perhaps does appealing to the kind of audience that watches the Superbowl.)

    Other possible problems (The possible non-causal relationships)

    A ≡ B. Tautology / identity.
    E.g. If my paternal grandfather's only son is called 'Martin' then my father is called 'Martin'. If the temperature is zero Centigrade then it is 32 degrees Fahrenheit. One doesn't cause the other: it is another way of referring to or describing the same thing. They will be perfectly correlated, not because of causation, but due to another kind of determination.

    Conversely, there can be complete determination by definition, yet zero correlation because correlation is a linear relationship. E.g. as in the equation   y = {x   ×   x}   or   y = {x^2} .

    The slogans

    Correlation does not entail causation. (Or as it is more often expressed, correlation does not necessarily imply causation. Or as it is a little carelessly put even more often "correlation does not imply causation", even though in fact some of the most important scientific advances have come precisely because scientists did investigate that implication.)

    As Tufte observes (following David Hume), it's more accurate to say:
    Empirically observed covariation is a necessary but not sufficient condition for causality
    or
    Correlation is not causation but it sure is a hint

    A variation: traits (and correlations over time)

    A similar tendency to faulty inference occurs around time scales and states vs. traits. Just because a property of a person (or thing) is "reliable", i.e. strongly correlated over time when you do test, re-test measures, this doesn't tell you anything about how easy it might be to change it; but the temptation is to label it a trait.
  • A person may be poor for years, but one windfall can change that forever overnight.
  • If you insist people express a preference for visual over audio materials for learning, they will do so in a moderately "reliable" way. But this is not predictive of how well they learn with each kind of material, even though that inference is drawn by large numbers of published papers.
  • For a long period in the UK, few girls studied science subjects and it was assumed that strong forces were at work. When enough pressure was applied to teachers to make them change their advice, then the numbers changed in less than a year in the schools where that pressure had been applied. It turned out there were no large forces on or within the girls preventing it, despite it being a big effect, and highly reliable up to that time.

    On the other hand:

  • Many smokers believe they can stop any time, and that the predictability and stability of their habit is misleading. The evidence is against that.
  • Human body weight is extremely resistant to dietary change: (past weight is a good predictor of future weight). Because there are many feedback mechanisms that adjust to cancel out changes of food input.
  • Contrary to what was believed at one time, sexual orientation and identity can be very resistant to even extreme external social pressure.

    Reliability (i.e. correlation over time) is no predictor of how easy or likely something is to change.


    Last changed 14 Feb 2011   ..............   Length about 9600 words (69,000 bytes).
    (Document started on 1 June 2010.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/creative.html. You may copy it. How to refer to it.

    Creativity

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Introduction
    Personally, I've had a long dislike of the notion of "creativity". My values are truth (for pure research), and utility (for applied fields); but creativity is defined in terms of novelty. Novelty has nothing to do with whether something is a good idea or an effective technique; neither does who should get the credit for it. However various things have combined to make me jot down a few basic ideas a) to orient myself in this topic; and b) to explore some connections of creativity with education e.g. how to teach it (e.g. to engineers), and how to assess it if you do teach it.

    That personal dislike may be due to my discipline. It is important to recognise that some disciplines require their students to exhibit creativity, originality (even if in fact they don't really have any): to be different from the student next to them. Others require their students to conceal it, even if in fact they are creative; and to make it look as if their suggestions proceed from evidence or authority, not from themselves. There is no a priori reason to assume there will be or can be any agreement about creativity; not even about whether it is a good thing. The phrase "creative accounting" in fact illustrates that creativity can be criminal, and is certainly NOT a core disciplinary value in some areas e.g. those which stress reliablity, safety, accuracy.

    Definitions of creativity: (N.B. should we be defining novelty, originality, or creativity?)

  • "Thinking of new ways to do things is a crucial part of who you are. You are never content with doing something the conventional way if a better way is possible" [from the VIA strengths questionnaire, assessing whether creativity is a personal strength]
  • "Creativity is the ability to come up with ideas or artefacts that are new, surprising, and valuable." [from Boden]
  • "A set of skills and attitudes needed in generating ideas and products that are relatively novel, high in quality and appropriate to task in hand." [Amibile]
  • "Creating" is the new top level of Bloom's taxonomy as redefined by [Anderson & Krathwohl et al.] See this page especially table 1 and also:
  • Table 8, which relates it to the spectrum of learning transfer. [me]

    My summary (much like Boden's) would be that creativity must have:

  • Human agency (as its cause)
  • Utility
  • Novelty
  • Surprise
    Novelty without value is not wanted (e.g. the splash a dropped meal makes on the floor). Even being novel and useful but pedestrian is what we require from employees following rules, and is not enough for "creativity", so surprise is also required. (N.B. surprise entails novelty, but not vice versa.) Also required is agency (normally human): we don't normally say a sunset is creative, however surprising, novel, and pleasurable it may be (after a volcanic eruption, say). Note that surprise is a psychological perception, but the first three conditions could (sometimes with difficulty) be defined/measured objectively.

    Boden's view, and mine too, is that creativity consists of generating a new combination of old elements.

    Note too that creativity generally refers to the idea or design, rather than to the material object created or manufactured to embody it. (A foundry worker may produce a bronze statue, but we attribute creativity to the sculptor, even though the word "create / creativity" seems to imply physical bringing into existence.)

    Interlude / note Creativity vs. originality?
    I saw a competition which had both of these as criteria, as if independent.

    Originality is (roughly) novelty: but usually relative to a group rather than to the inventor. (H-creativity: see below.)
    Example of originality and no creativity: accidental selection from things, objets trouvés.
    Example of creativity and no originality: P-creativity

    The 0th dimension: Human agency as the origin of the product or idea
    Creativity vs. discovery: if a surprising and valued thing has not been created by humans, then we say it is discovered. In current English usage, even those who speak (religiously) of a creator, do not seem to say that God is creative. (It would be odd to say that an omniscient, omnipotent being surprised herself.) We use "creative" to discuss human production, not natural or supernatural creation. Similarly, if something is plagiarised, it might be novel to its readers but not to the plagiariser. All this suggests that "creativity" is about how minds surprise themselves and each other.

    The 1st dimension: Utility
    It is presupposed, required, that anything that is called creative is somehow useful practically or "interesting" i.e. of value intellectually. However it is hard to define this simply because discussions of creativity are frequently about things whose value is only recognised, at least by most people, later. Faraday is famously said to have replied to the question of what good electricity was by "Madam, what good is a baby?". It illustrates that at that time ordinary people couldn't see any application for electricity: but he had faith in it. Conversely, many artifacts are invented and sold, only for their users to develop new uses (new value) undreamt of by the "inventor".

    However value is not only tricky to perceive for the future, it is often different for the individual and for the group. That is, there are things that are useful and interesting to me, but not to others (my family history, my "piling system" -- my arrangement of work in superficially disorganised piles). Conversely, things of quite low quality are often very important as a whole just because so many people want them a bit that economics makes them cheap and plentiful e.g. air travel, soap operas.

    In fact value is not quite independent of agency ...

    [?] I-creativity: Idiosyncratic value. Some things have a utility (e.g. "sentimental value") not really because it depends on the individual's judgement, but because what is useful to one person really is sometimes different from what is useful to someone else (e.g. a prosthetic leg, ...).
    [?] POP-creativity: popular/populist value. Here value is defined by the group, not the individual. Where mass market appeal means large numbers value the product, even if only a little bit. Soap operas, cheap air flights are examples of this, because the mass market makes it economical to satisfy demand for quite low-utility things.

    Thus value is relative to the person or group, but can in principle be objectively measured by a third party.

    The 2nd dimension: Novelty
    Maggie Boden distinguishes:
    [1] P-creativity ("Person")
    [2] H-creativity ("Historical").
    The former is something new to the individual person who creates it; the latter is new to the human race. Obviously a person may re-invent something so it is a creative mental act for them, but not a contribution to human culture unless no-one else has done it already. Conversely, as discussed in a moment below, we may be completely unaware of the source of our thought i.e. feel it is an original, creative insight, yet it could be obviously (to others) derived from someone else.

    This dimension, generating the two types above, is important to cognitive models of how a person can generate new ideas. A cognitive model needs to be of P-creativity; and then we can explain H-creativity as caused by the P-creativity of the first person to have that idea. This distinction is also of great importance to education. Constructivism asserts that all significant learning is P-creative: requiring re-construction inside the learner's mind. And to a great extent, in our culture at least, we define learning in terms of "transfer": i.e. the capability of doing something with a new idea that is more than a tape recorder can: of applying it in a new context we haven't previously considered. This has a significant element of creativity: of being able to put the old idea and new context together in a combination (and with consequences) that is new to the learner i.e. is P-creative.

    Thus novelty too is relative to a person or group (society), but can in principle be objectively measured by a third party.

    Social credit. An important mechanism. ....?
    Note however that it is just our current culture (society) that makes much of creative artists, engineers, and scientists. Medieval cathedrals, in contrast, were designed and built by individuals we know almost nothing of: no such social value was then put on celebrating those responsible for "creativity". So H-creativity is not equally interesting in all societies. And note too that our culture doesn't apply it to all things: new words are coined all the time, but credit is not given to the originators. In fact most people don't even know that many of our words were coined by Shakespeare: we credit him with other kinds of creativity.

    The 3rd dimension: Surprise
    Surprise ≈ a shift in expectations more than in reality or achievement.

    Boden's two types assume a godlike, hindsight view of whether something is novel (to the person or mankind respectively). However also interesting and important is whether a person perceives something they do as creative. This is often unrelated to the actual case. For instance research in AI and linguistics shows that many, perhaps most, sentences a person utters are new: that person has never uttered them before. However no-one feels that this is creative, perhaps because essentially everyone not only can do it, but does it every day. On the other hand, feeling original ("creative") is often important to people. What it is that determines whether people feel, i.e. judge themselves to be, creative is an additional important topic we need to study. This is analogous to metamemory: people's considerable, though imperfect, ability to know whether they know something before and without actually recalling it. Although intuitively we associate surprise with suddenness, in reality that is irrelevant. What defines surprise is violation of expectancy. An ambush, no matter how suddenly fighting bursts out, is not a surprise if superior reconnaissance has warned the intended victims. Conversely, people may be very slow to adjust their expectations but we would still say an act was creative even if it took years for many to accept it.

    Judging whether something is creative is important to us. So there are two more types of creativity that are subjective.

    [3] SP-creativity: self-perceived creativity. This relates to self-actualisation: when a person feels they are being creative, creating a way of doing something that is new to them. Maslow's notion of self-actualisation, and the use in Positive Psychology of "creativity" as one of 24 strengths a human may have are indicators of how important this is. Thus whether a person feels they are creative seems to be linked to their well-being. As we have seen, this is a perception, and has no clear relationship to available objective measures of creativity.

    [4] GP-creativity: group-perceived creativity. Group acclaim. This is when other people, one's peers, one's society perceive you as having done something creative: i.e. novel to them and useful. While in some respects contemptible ("just fashion"), this valuing is built on the fundamental implicit values of all communication: to only say things that are relevant, and a major necessary condition of relevance is that the Hearers do not already know what you are saying. Thus (perceived) novelty is in fact absolutely necessary to communication (otherwise we would be stalled, repeating the endless number of things the other person already knows).

    Surprise is about a clash between something we encounter and our meta-memory-like sense of what to expect. We run our lives, not by having exhaustive plans for everything, but by having a good estimate of the things we need to prepare for and the things we can expect to deal with as and when they come up. For example, many people expect to go abroad for a holiday once a year, but probably only have plans about one year ahead: they just assume they will be able to plan and achieve further holidays beyond that. You can see in the press how this applies to other things. We tend to feel that an effective flu vaccine is to be expected, and are critical when one is not available; but we don't expect a machine that stops earthquakes to be invented. This dimension of surprise is about not having predicted the existence of a solution to a problem, or about the revelation of unintended consequences (good, bad, or mixed) of some invention.

    The point is that there are often some relatively short duration moments when new implications come into view during the process of developing an idea, rather like the way a dozen steps, out of the thousands it takes to climb a hill, sometimes uncover (or hide) a large vista. In design, this might be a new use (application), or perhaps realising for the first time that there is an application at all. These estimates (surprises) are what make it so hard both to foresee the future and to decide how much to worry about identified problems. Surprise is a sudden shift in our (meta-memory type) estimate of what can be developed, be expected to be doable.

    See also Rob Saunders. He has a computational model of creativity; and it employs a kind of (a simulation of) peer evaluation of proposed ideas that is in effect a judgement procedure for GP-creativity (Blay says).

    It seems obviously absurd to say "Columbus discovered America", not only because Columbus died still believing he had reached Asia and never knew it was a continent new to him, but because the continent had been there for tens or hundreds of millions of years before humans, and humans had lived there for thousands of years before Columbus stumbled on it, and even among Europeans the Vikings had preceded him. But it does illustrate how important it is for a social group, when it learns something new (cf. H-creativity); and also that the "group" that seems important here is not a political group but in some functional sense a community of knowledge (in this case, Europe rather than Spain, or the profession of navigators, or ...). It also shows how creativity is relative to a wider group: is about the entrance of knowledge to this wider group.

    In fact this case illustrates that the social group concerned must be about sharing knowledge. Vikings seem not to have passed on their knowledge of America effectively, and it had been forgotten. The Chinese had in fact also sailed to America shortly before; and sent back written accounts; but this knowledge had been suppressed in China. Thus surprise is relative to a person or group; but it is doubtful if it can be objectively measured by a third party because it is a subjective feeling or perception, albeit with considerable consensus among people in many cases.

    You can't have surprise without novelty, but surprise adds an additional requirement to novelty. So should I use surprise but drop novelty as a distinct defining condition for creativity? Novelty can in principle be established objectively by historical data, but surprise is defined by expectations: essentially a subjective measure of mental attitudes not of observable behaviour. Thus they bring out different aspects of our concept of creativity.

    Summary table: types of creativity product

    Types of creativity (product)
    As judged by: ↓ Relative to the: → Individual Group
    Utility Useful / interesting as judged by whom? → I-creativity
    Idiosyncratic needs,
    convenience,
    curiosity
    (learning)
    POP-creativity
    Mass market appeal
    e.g.cheap air travel
    (teaching)
    Novelty Novel to whom? →
    Objective;
    Actual novelty
    P-creativity
    A first for that person
    H-creativity
    A first for humanity
    Originality
    Surprise Surprising to whom? →
    Subjective;
    perceived novelty
    SP-creativity
    Self-actualisation
    GP-creativity
    Group acclaim, relevance

    Agency, and types of process for creativity

    (See also Malcolm Gladwell's book Blink.)

    Of the four defining properties of creativity, three were seen as describing the product and dealt with above. This section addresses the remaining property of creativity: the "zero-th" dimension of human agency. This has two aspects: the human (who or where do the ideas come from; and what are the relevant connections between creativity and being human), and agency (is it a purposeful process or not; or can it be accidental). This leads to broadening the discussion at times beyond creativity (just as not everything surprising is creative, so not everything with human agency counts as creative). However what defines the theme of this section is process as opposed to the product (the result of a creative act) which was the focus of the previous section. This section develops a set of dimensions or attributes of processes. The aim is that all creative processes can be compared and contrasted by these attributes, although other processes, especially those leading to products called "discoveries" rather than "creative", can also be compared here.

    By the end of the whole section, we can return to summarise what we have uncovered about the relationship of agency or purposefulness to the process of creativity, and the connection of humans to it (as opposed, say, to a machine for creativity).

    It is clear from everyday usage of the term "creativity" that it is only applied to human actions, but this is so entirely taken for granted that it is not mentioned in the definitions of creativity that I've come across. However it seems clear, if implicit, from Aristotle's classification of types of cause that we can find a way to see almost anything both as caused by a person, and as caused by non-human factors. Blame games (and praise games) focus on human agents as the cause and are derided for wishing to ignore non-human causes that may be more sensible. Similarly modern psychology documents "attribution biasses": tendencies to attribute causes that, because of their assymmetries, cannot be rational e.g. people tend to explain their own actions as due to external pressures, but others' actions as due to their inherent traits. Thus there is generally a huge middle ground in which, without being grossly irrational, we may either choose a perspective that explains events as due to human intentional action, or alternatively another perspective that explains them as due to non-human, material causes. Even though the simple analysis of everyday uses of "creativity" shows that it is generally a label emphasising human intention as the central driving cause, any attempt to deal with creativity from a third party perspective (e.g. assessing students for creativity) probably needs to recognise that a product that could count as creative could often alternatively be seen as a non-creative consequence of other factors.

    These are issues of the process of creativity, rather than the product. They raise issues of who or what the driving force for the process is, what they already had and what they seek out, ....

    Why should we need humans' (rather than a machine's) creativity?
    Why should we need purposefulness (agency) for creativity?

    Gradualism vs. catastrophism
    While a favourite type of story is of Eureka moments, where an original insight appears in a flash, this "catastrophism" is distorting as an account of creativity since slow, incremental, trial and error improvements are far more common; whether of a design for a toaster, a new jet aircraft, or a piece of writing. "Step by tedious step, we stumble away from abject failure. And that's on a good day." [Barth Netterfield] Slow incremental evolution ("gradualism") is a process where P-creativity, and SP-creativity, are much less than H-creativity: the former diminishes to a tiny value as the inventor gets sick of endless little changes, while the H-creativity slowly goes up as the value which the product will have when the public finally gets to see it increases. Another argument against catastrophism as the usual mechanism of creativity are the many cases where artifacts are used for purposes the inventor did not envisage: and so could not possibly have "been creative" about. I.e. this is H-creativity without P-creativity; and where the users discover uses for the invention which the "inventor" did not know or value. It may be that the construction of solutions is gradual, yet the experience of surprise sudden. And/ or that creativity seems or is gradual for the individual inventor, but sudden for society.

    Gradualism vs. catastrophism have been important rival schools of explanation in Geology in the past; and later (today) in Evolution theory. In both fields, the eventual view seems to be that there are cases of both, and this is probably the case with creativity. However we should note the metaphor sketched earlier, of how most steps up a mountain make only gradual changes to the vista, but a few steps are associated with rapid, even dramatic, shifts in what is in view. Since surprise is an essential aspect of creativity, we should perhaps expect that creativity often feels as if it is a sudden (catastrophic) process, yet is actually an outcome of generally much slower processes.

    This time scale dimension, or choice of perspective, is independent of the other issues of agency.

    The gradual vs. sudden timescale of the process of creativity seems related to the surprise dimension of the product. However the argument above about the surprise dimension is that that is essentially about a readjustment of expectations, rather than the shortness of the period in which this is done. For example, the Sydney opera house took over 14 years to construct, yet everyone regards it as creative and in large part because it was so markedly different from what, up till then, you might expect of an opera house.

    The source: Where does the information used in creativity come from?
    Help from whom or what?
    As soon as you realise that creativity might not be instantaneous but iterative, stepwise, then the question arises as to whether the inventor gets help (information) during the creative process. They might not: some things are just worked out in the head yet take a long time. But they might: they might get information from experiments and observations on inanimate things. Or from a human authority; or a collaborator; or from feedback from user testing. In which case, should the search-director get the credit or the source of the information? Do you own your own genes, or do they belong to the biologist who sequences them?

    This is the first aspect of the issue of whether an innovation "comes from" a person: the inventor. In some cases and senses it does. But it seems clear that in others, the director / inventor may also obtain vital information from other people. The types of source of information that may be important to feed creative outputs are:

    Thus even if we require a human agent for creativity, the process more often than not involves seeking out information from other things or other people, and doesn't just emerge from inside the inventor's mind.

    If the search depends on other people or things, why attribute its value to the director?

    Search, and Purposefulness (Agency)
    Was there any intentional, directed human effort behind a new idea, or piece of it, at all? The main alternatives may be:

    Thus items may be discovered accidentally. We should however note that even then it may only be noticed, observed, and reported by a trained observer, and not by other people. When Fleming discovered penicillin, a non-biologist would have been unlikely to recognise that the absence of bacteria was an active sign of death, the sign of the presence of an invisible antibiotic substance.

    Considering the gradual nature of some creative processes, extended over time, and how information sources other than the inventor's own mind are frequently central, both demonstrate the role of purposefulness or agency. The agent manages a search for answers, and may use the answers obtained in ways different from any of the people who may have provided the answer. This is not like a Eureka moment, but it is like an artist endlessly "oversketching" (drawing many versions of the same line in a sketch to see which looks best or right), a poet repeatedly changing this or that word, an engineer trying different materials or shapes for their new device.

    The process of searching for answers has several contrasting types, depending on the question. One type of search is to answer a specific closed question e.g. looking up someone's email address. The other extreme is an open-ended question such as "What is over the next hill?", what happens when you mix these two substances? etc.

    And furthermore, even when there is no active search, it still takes an important mental property to recognise something important when you come across it by accident (like Fleming). The unprepared mind tends not to notice and does not act on it; the prepared one does. On the whole, though you may discover something by accident, you don't say something was created by accident.

    Purposeful (2)? Was there any purpose at all behind the invention?
    We tend to use the term "discovery" in science and geography, and to use it for the parts separately. Also, discovery may be purposeful (searching for an answer), intentional, and human. Yet we don't say "creative" about such things. That may be because there is no surprise: if the question is precise and formulated, then the existence of an answer is not surprising. (Meta-memory again.) Climbing Everest for the first time was not surprising for the spectators, though enough for the news.

    Invention, creativity is more about putting the two parts together; and also thereby solving a problem. Creativity is about something human: a problem that is solved; not a dispassionate description of the world.

    There are two (at least) opposing accounts of innovation: one is the Eureka one, attributing it to creativity: to mental creation by an individual with no antecedants we are aware of. The other is of correcting the bad practices of the past in order to do it right: which is not being creative but seeing how to do it the Lord's way / the scientific way i.e. learning from an external source whether authority or observation. Different disciplines have different preferences for these two accounts. If the external source is observation, then we might call it "external context"; if it is other people ....

    The two parts of a creative idea. (If there is a purposeful search) What is sought? Creativity as project management and purposefulness
    An important point to recognise here is that all inventions or creative ideas are in fact the mating of two parts: a) the value, purpose, function, utility: what it is for, what problem it solves; with b) the solution, method, device, painting that illustrates and embodies it. This is obvious in product design, but applies equally to a poem or painting: what distinguishes them from random noise is that some people see them as valuable, novel, and unexpected (even though articulating that value in descriptive language is not required and usually not done.)

    Given that there are two parts, then an inventor is someone who puts them together but may not have invented both or either part in themselves. Frequently they begin with one and search for something that can play the part of the other. All find a way to fill the role of the other part. That means the essential creative act may be one of directing, managing the search, rather than supplying the parts.

    We can then subcategorise creative acts depending on which parts were there from the start, which found later; which were accidentally "found", which searched for. For example professional inventors may decide on the need for a new mousetrap or a videophone, and seek for a solution. Others however have stumbled on (discovered) a surprising feature and searched for a goal, for what it could be useful for. Post-it notes were invented when a glue firm accidentally invented one of the weakest glues ever seen, and wondered how that could possibly have a use. Similarly, SMS mobile phone texting was a function engineers realised was "there" anyway in the system they had built for voice, and could be offered to customers without any great investment or running expense: but it was a great surprise when it was seen as so useful by users.

    Put another way, two things are needed for a creation: a purpose or goal or identified value; and a solution or method for satisfying it. The 4 possibilities for a purposeful agent then are:

    If it is sought, then is it only discovered?

    So perhaps the inventor, the creative person, is the one who directs the search, rather than who generates the idea from nothing alone. This is also about whether the innovation "comes from" a person; and specifically about the project director role, distinct from who discovers the ideas about the parts.

    The above implies that there are not one but two things, bits of information, ideas to acquire in any invention, plus the idea of combining them. But it also implies that there is an essential role for a director in putting them together, distinct from being the source of the parts. This is a definition of a creator: the person who manages the process, and brings about the putting together of the two parts.

    Perhaps, if we maintain that human agency must be behind anything creative, there are 2 roles for the creative: a) putting the two parts (value and method) together; b) actively searching for one or both of the parts. You can discover facts / things; but creativity requires a problem, goal, need.

    In essence, discovery is a one part process, while creativity is defined by combining two parts.

    Discovery vs. creativity
    In some cases it is hard to identify why we would call a case discovery rather than creativity. In many cases however it is easy.

  • Discovery may or or may not be intended, and the result of human agency; i.e. have a manager / director. (Creativity must be.)
  • Discovery may be surprising, or not. (Creativity must be.)
  • A discovery may have utility, or not. (Creativity must have.)
  • Discovery may be only about value or method. (Creativity must have both; i.e. must have both of the two parts.)

  • Discovery, like creativity, may be either gradual or sudden.
  • Discovery, like creativity, must be novel.
  • Discovery, like creativity, may have as its information source the discoverer (e.g. discovering a new maths proof) or may depend on other sources.

    However for cases which qualify for creativity as well as discovery on all the above issues, there may remain a different kind of ambiguity about which it is. "Discovery" implies it is about external facts, not human wishes. However, as illustrated by Aristotle's ideas of causes, and by the psychological theory of attribution error, there is in many cases an ambiguity in how you interpret any one thing.

    There is latitude in whether we attribute a discovery to creativity or not. The element Radium was isolated by Curie after much effort: it does occur in nature, but no-one knew it was there and it isn't easy to get hold of. Plutonium owes the possibility of its existence and its nature and properties to the same laws of physics as Radium, but in contrast does not occur in nature but is physically created (manufactured) in nuclear reactors. BUT the idea is not manufactured, so it's not creative.

    Yet no doubt many things get reinvented: perhaps this is P-creativity.

    The problems with drawing a clear line between discovery and creativity are, or include:

    Thus in part the distinction between discovery and creativity is not a matter of definition but of the perspective adopted by those selecting the term. If your attribution is focussed on what is different about the human involved, then "creativity" is the term. If it focussed on the world, on the non-human factors, then "discovery" feels more appropriate.

    Summary

    My overall arg. structure for the summary
    1. Mgt and the 2 part issue: a core defining issue
      Entailment of this:
      • Director-mgt role is essential, not the info source role.
      • Various types depending what came first and from ?. [=see table?]
      • Brings out discovery vs. creativity
    2. Discovery / creativity: relocate as w/w/o value and/or surprise. This is an immediate next section following one on mgt. You can have surprise but w/w/o value.
    3. Summary of possible aspects of agent
      Summary of possible aspects of human
    4. The essential (as opposed to possible) aspects for creativity:
      • Has value: but doesn't need a human creator to measure this
      • Perhaps is deliberately worked on (2 parts put together)
        Could it be a machine agent?
        If software can surprise humans?
        Simulations do.

    Text of the section

    An essential feature of creativity with significant consequences for the process of creativity is that the essential role is not the physical production but intellectual production, and that it is not the production of the intellectual elements, but the fitting together of two parts (the function or value, and the solution or method). Thus it is the role of director or manager that is essential, not the role of information source. It also follows that creative processes could be classified depending on which of the two elements came first and was the starting point for a search for the second. It also leads to a distinction between creativity and discovery, which is the production of one element and without any assumption of purpose.

    Gradualism: makes the need for purposeful mgt more evident.

  • Discovery may be surprising, or not. (Creativity must be.)
  • A discovery may have value, or not. (Creativity must have.)

    There are two distinct needs for purposefulness in creativity:

    1. To manage the overall process, the combining of an idea about a need, and idea for a method.
    2. To carry out a search for a piece of information.

    There are three distinct roles for human involvement:

    1. As an information source for the creator (though non-human sources may also be used).
    2. Humans are particularly important as sources of information about human needs or wants. Market research exemplifies this: asking people about what they might want or buy.
    3. Humans may be agents i.e. act purposefully (though in some senses, software may carry out searches too).

    Creativity must have:

    Conclusion: The dimensions (variable properties) of the creativity process

    In summary, I propose the following dimensions of the process of creativity, which are explored in the following tables. The first is one of the necessary defining conditions for creativity (human agency), while the others are dimensions on which the process of creativity varies between instances.

    I claim that these dimensions apply equally to technology (product design), Art, and also to entrepreneurial design of services, and to pure science. (Although I am personally more familiar with cases from technological creativity.)

    1. Is there a manager (inventor), actively seeking the answer?
    2. Which of the 2 parts came first? I.e. {Solution, value} X {Given, sought}
    3. Information source: {Solution, value} X {Inventor, other people, observed world}
    4. Gradual vs. sudden, relative to group vs. individual

    Firstly, the question of whether there is an inventor acting as manager at all: in other words, whether the case satisfies the necessary condition ("0th dimension") for creativity of being due to human agency. Cases that do not nevertheless help by giving us a perspective on those that do, so a few are included as examples. Examples where an invention is just noticed, and so arguably cannot qualify as creative, are where both value and solution are noticed together. One case is noticing that sunken ships in some locations have functioned to begin a new reef: and now some ships have been placed and sunk deliberately for that purpose. Another might be noticing that cigarette smoke tends to repel midges, then smoking for that purpose. I.e. is there an active manager, or was the "creation" just observed and adopted?

    Secondly, since (according to the argument here) there are always 2 parts to any creativity which consists precisely of joining them, and the inventor's job is that of a manager who searches for the missing part, then we can classify each case by which of the two parts was "given" (there already), and which was searched for. If both are given then it is a case of no creativity (discovering something useful, as above). If neither are given, then it is a case of a professional inventor setting out to do invention by simultaneously looking for unsatisifed needs (functions) and for solutions that match them.

    Thirdly are the dimensions of information source: for each of value and solution, who or what supplied the information? The basic idea is whether it comes out of the "director's" head (as in painting and maths) or from testing the world, or asking other people. However a major reason for not having a single clear answer to this in many cases is that often, there may be a demonstrated key element that should make a solution possible, yet there also needs to be a substantial development process to establish how the solution can be reliably and economically produced. Penicillin is an example of how crucial this step is. In fact the same applies to the "value" element as well: managers may hit on a use they believe in, but only much further work and rolling it out will in fact prove whether or not there is real demand for it. This leads to ambiguity in how to describe each case and fill in entries to the table.

    Fourthly is the issue of whether the process is perceives as sudden or gradual, and by each of the inventor and the surrounding social group.

    Additionally is the contrast between pure science and saleable technology. Both are creative in these terms, but a science goal concerns the value of knowledge. In fact in both cases, the value is only really known (established) after the creation is fully delivered, and even then can change in time as the context changes.

    Illustrative tables of the attributes of the process

    This table illustrates how creations may be sudden or gradual; and how the perception of this is different from the viewpoints of the inventor or of others (the group).
    Perceived suddenness of the creativity process
    Perceived by others
    Sudden Gradual
    Perceived by inventor Sudden Find a new species, SMS
    [Neither function nor solution anticipated]
    NW passage, cure ulcers, 4-colour theorem proof
    [Sudden solutions to long standing goals]
    Gradual Aniline dyes, PostIt
    [Slow development for unanticipated utility]
    Fusion power, maleria vaccine
    [Gradual progress on longstanding goals]


    This table illustrates how either part may come first (be a "given") or second (be sought by the inventor).
    Which of the 2 parts came first?
    Utility
    Given Sought
    Solution Given Use sunken ships to create a reef
    [Discovery not creativity]
    Aniline dyes, PostIt notes
    Sought Zero resistance electrical wire, HIV vaccine, Green automobiles Jackson Pollock, Radium, Penicillin-Florey
    [Professional inventors]

    Summary table: cases with the attributes of the creativity process for each

    This table compares and classifies different cases of creativity by these process properties.

    A creative design has:

    Dimensions of the creativity process
    Active director? Which part sought? Info source? Time
    If no=> not creative Value Solution Value Solution Inventor Social group
    Yes/No given/sought given/sought Dir/Others/World Dir/Others/World Sudden/Gradual Sudden/Gradual
    SMS phone texting Yes Sought Given Dir/Others Dir Sudden Sudden
    Penicillin,Fleming No Given Given Dir world Sudden -
    Penicillin,Florey Yes Given Sought world world Gradual Sudden
    PostIt notes Yes Sought Given Dir Dir Gradual Sudden
    DNA fingerprinting Yes Sought Given Dir Dir Gradual Sudden
    Perkins' aniline dye Yes Sought Given Dir Dir Sudden Sudden
    Sunken ships to initiate reefs No Given Given world world Sudden Sudden
    Columbus Yes - Dir - World Gradual? Sudden
    Radium (for sci) Yes Sought Sought Dir world/Dir Gradual Sudden
    Painting (perspective) Yes Sought Given Dir Others/Dir Gradual Gradual
    JacksonPollock Yes Sought Sought Dir Dir Gradual Gradual
    A new species Yes Given Sought Others World Sudden Sudden
    Plutonium for bombs Yes Given Sought Others world Gradual Sudden
    Kissograms Yes Sought Given Dir Others/Dir Gradual Sudden
    Proof of the 4 colour theorem Yes Given Sought Others Dir Gradual Gradual
    Vaccine for HIV Yes Given Sought Others Dir Not yet achieved Not yet achieved
    Zero electrical resistance wire ? Given Sought Others World ? gradual

    I shall here discuss each case, and the problems I have in filling in the table for it.

    PostIt: the research group discovered the weak glue accidentally, then searched for a use for it purposefully, and found it. They played the Director (manager) role; they also acted as the information sources.

    SMS (phone texting). The engineering group had already to implement the channel that would be used for it as the "control" channel by which mobile phones liase with stationary masts, and are handed off between them. They saw that this channel could also be used for carrying user messages with no new hardware, and no difficult extra software to write, and no costs to the supplier provided delivery time wasn't guaranteed. They imagined it would have some value, but probably hugely underestimated how much: this was later "discovered" by observing actual customer use.

    Penicillin: Fleming noticed an unusual pattern of bacterial growth in a dish; inferred that this was due to a fungus which he was able to identify and culture; isolated the substance it secreted and speculated that it would be useful medically. Florey decided to attempt to work at developing an anti-bacterial drug; chose penicillin (he presumably would have gone on to try others if this was not successful); developed ways of manufacturing it in usable quantities; and ran medical trials to establish whether it was useful. If you regard Fleming as the discoverer of pencillin in the sense of someone who created a drug hospitals could order and use, then Florey did nothing more important than a foundry worker producing a bronze sculpture. But Fleming completely failed to develop a production process and so could not treat let alone cure any human. This led to the deaths of millions of people in the years between his observation and the development of Florey's drug supply. We could thus see Florey, but not Fleming, as creative: managing a purposeful process that verified and connected a value with a working solution for delivering that value.

    Columbus had a purposeful project of discovery. He didn't discover what he had planned to, so his actual discovery was accidental; and he never correctly understood what he had discovered. He wasn't the first human to discover it (that would be the people already living there); he wasn't the first European to reach the continent (that was the Vikings) but he did discover / establish a quite different method of sailing there (at the time, much more crucial than just knowing the geographical coordinates); but most importantly, his discovery became disseminated throughout the European world. Although he probably had various utilities in mind, what has proved useful was the knowledge of his discovery, not particular planned material advantages (gold, ...).

    Marie Curie discovered the element Radium after a planned search and heroic labour, isolating a few grams from tons of pitchblende (Uranium ore). It was the first knowledge of its existence, and measurement of its properties. Its human applications were invented later and by others. Thus from an engineering viewpoint, this was discovery not creativity because it had no human utility; while later people who developed applications (e.g. using it to create glow-in-the-dark paint for watches) were creative.

    However from the viewpoint of creative science, the value was the identification of a new element and its properties, especially radioactive properties. In effect there was a puzzle (accounting in detail for the radioactivity of pitchblende) and both the method for answering it and the answer itself had to be pursued.

    Kissograms: an example of entrepreneurial creativity, where a new value (utility) is imagined, verified, and a means developed to supply it. I.e. creativity needn't be to do with either science, technology, nor art. In fact, the means (solution) could be viewed as given and the creativity was in recognising that people might use it and pay for it.

    DNA fingerprinting is essentially like PostIt notes: an unexpected property was observed; and then a use for it was thought up. This brings up a common ambiguity: although it started with a surprising discovery that would become the essential part of the "solution", even after inventing the application (utility), the solution had to be developed into a practicable and reliable procedure: reworking the solution from feasibility study to tested solution.

    Discovering a new species (whether fossilised or living in the wild): biologists go out to look, say, for new beetles. By examining every on they find they will recognise a new species. The value is given, and obvious: zoology is still interested in new species, though the amount of scientific value of each new one is only known after discovery and depends on how unexpected it is. Scientists would normally call this "discover", yet it has all the attributes of creativity.

    Perkins examined the sludge from a failed experiment in organic chemistry and observed a strong mauve colour. He then thought of the application of fabric dyeing and established it as practicable.

    The 4 colour theorem was a long standing conjecture in maths: i.e. everyone thought it was true, but couldn't find a way to prove it. So the utility was long established, and concerted efforts to find the "solution" were made, eventually successful after a very long time.

    Similarly for malaria vaccine, and fusion as a practicable power source, except that success even after all this time is still at best partial, and it is still not known if it will ever be really successful.

    Perspective painting: a story we might tell is that artists wished to create a stronger impression of visual realism and sought, then developed, the system of perspective.

    With Jackson Pollock he developed both novel ways of painting (no brushes, horizontal canvases to take liquid paint), and an aspect of visual experience that his pictures isolated and brought out. If that story is correct, then w.r.t. creativity he (and no doubt numerous other major painters such as Picasso) developed novelty simultaneously in both parts (aim, method): as professional inventors do for product design.

    Assessing students on creativity

    There are three ways in which we could say that creativity is already commonly assessed in various academic disciplines, without calling it that.

    Firstly, all assessment tests require "transfer": using what was learned in a new context. The question is, how far is the transfer? Reciting a poem learned by heart is transfering only to another time and place, but using identical words (very near transfer). A test on fractions might vary the actual digits each time, but the method would be identical. Another step up, would give the numbers in words not digits; a further step might ask about proportions or percentages rather than using the word "fraction": and not all children have grasped the connections. All tests test transfer; and some test ability to transfer the knowledge to significantly distant cases and contexts: and so are testing one important kind of creativity. (See here Table 8, which relates creativity to the spectrum of learning transfer.)

    Another kind of creativity assessment is the exam essay e.g. in History. While essays sometimes only elicit direct recall and reproduction, they are also often used to confront students with an unexpected proposition, and the learner is required to construct a critical thinking argument for and/or against the proposition, recruiting what they know and re-using it for this discussion. This is creative in the classic sense: uses old elements, but re-configuring them into a novel combination for a new purpose. In modern educational terms, it might be boasted of as testing critical thinking or higher-order Bloom goal types. The students who do this certainly feel an engagement and elation that indicates that it is experienced as creative (and self-actualising) by them.

    The third familiar assessment method concerns problem-solving tasks, and in particular Johnstone's analysis of designing creative problem solving tasks for learners. Open-ended problems require the learner to decide on the goal (what will count as a solution), some on finding new methods, some will have incomplete information given. Thus such problems have more than one right answer; but probably only a few predicates (judgement criteria, metrics of goodness of a solution) which are largely agreed in advance.

    Finally: we could view assessing creativity (e.g. of painters or designers) as an expansion of this, but where the learner probably must add their own predicates, and where there are probably a very large number of predicates that are relevant (even if the designer in practice picks just a few to focus on). Thus if the task is to design a coffee mug, some of the obvious goals include: holding liquid, tolerating freezing and boiling temperatures, insulating it so hot coffee doesn't burn the user's hand and doesn't cool too quickly, being easily washable, not containing steel armature wires so it can be used in microwaves, etc. Designs will generally address some of these better than others, so no two designs will be the same even in intention, let alone in solution. On this perspective, designs could be assessed firstly (1) for which predicates (design goals) were addressed vs. forgotten (identifying value), and secondly (2) on how well the design addresses each one (identifying solutions). And then further assessed for novelty for the student (3) (was it a solution not mentioned in the textbook or lectures); (4) novelty for everyone (the solution has not been seen anywhere before); and (5) for surprise: a subjective judgement about how striking the solution seems (as the Sydney Opera house is novel).

    Some links on assessing creativity

  • The HEA has stuff on how to assess creativity
  • http://www.creativelearning.com/AssessingCreativity.htm
  • http://www.leeds.ac.uk/educol/documents/150029.htm
  • www.csd.abdn.ac.uk/~gritchie/papers/aisb01.pdf
  • www.gifted.uconn.edu/nrcgt/trefyoun.html
  • flux.futurelab.org.uk/projects/e-scape-assessing-creativity/
  • www.palatine.ac.uk/events/view/562/

    Links / References

  • Bloom's taxonomy of learning objectives: see here for references.

  • Boden, Margaret A. (1990) The Creative Mind: Myths and Mechanisms (London: Weidenfeld & Nicholson).
    Boden, Margaret A. (1994) "Précis of The Creative Mind: Myths and Mechanisms" Behavioural and Brain Sciences vol.17 no.3 pp.519-570
    Boden, Margaret A. (1995). Creativity and Unpredictability. Stanford Education and Humanities Review vol.4 no.2
    Nutshell: a 10 page summary of her book.

  • Boud,D. (1995) Enhancing learning through self assessment (Kogan Page, London)

  • Malcolm Gladwell (2005) Blink: The Power of Thinking Without Thinking

  • VIA questionnaire. Signature strengths (free online questionnaire) (creativity is one of their 24 character strengths) http://www.viacharacter.org/VIASurvey/tabid/55/Default.aspx
  • InQbate, a highly funded (2005-10) Centre of Excellence in Teaching and Learning in Creativity. See also Prof. Peter Childs
  • A talk I gave on creativity

  • Ken Robinson report (1999) All our futures: Creativity, culture and education (UK government report) PDF

  • Siddiqui, Zarrin S. (2008) "Creativity in higher education: great expectations" International Conference on Assessing Quality in Higher Education 2008 pp.226-237

    Acknowledgements

    This page has been prompted by an invitation to talk from eSharp, by conversations with Marianne Patera, and with Blay Whitby.

    To be included

    "It is wise to learn; it is God-like to create." John Saxe

    "The imagination imitates. It is the critical spirit that creates." Oscar Wilde

    Lev Landau's group was discussing a bright new theory, and one of his junior colleagues bragged that he had independently discovered the theory a couple of years ago, but did not bother to publish his finding.
    "I would not repeat this claim if I were you," Landau replied: "There is nothing wrong if one has not found a solution to a particular problem. However, if one has found it but does not publish it, he shows a poor judgment and inability to understand what important is in modern physics".

    ToDo

    I'm weakest on the dim. of info source.  Does this matter?
    
    And I have commented on, but perhaps not resolved, the issue of the
    difference between the first glimmer of each element of a creation, and
    establishing a reliable procedure (not the promise of one that will work
    sometimes).
    
    Social accounting E.g.s of task-artifact cycle: of users find new apps Anagrams? fit in somewhere? This needs e.g.s from: Art non-techno entrepreneurship geography or biology

    Problems

    Insight learning ??
    
    

    Reprise / Conclusion. If any final conclusion needed.

    Why human?
    Why agency?
    Creativity =~= p-solving, not all discovery.  Must have surprise (not too much purpose?)
    Aristotle again for creativity -> do need a purpose = telos (utility); and
    that is a human need.
    


    Last changed 18 Jan 2010 ............... Length about 900 words (6000 bytes).
    (Document started on 18 Jan 2010.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/curric.html. You may copy it. How to refer to it.

    xxxx

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    What's the difference between syllabus and curriculum?
    
    Put on a web page together (under best??);
    	or on existing page for syllabus if it exists
    	or on existing page for L-objects.
    
    Syllabus & curriculum
    Alec Johnstone in a talk seemed to be using:
    Syllabus = aims & objectives
    Curriculum = timetable (plan of M-acts).  [Willy Dunn[e] said that curriculum
    was coined at UoG, and referred to the set of set books that were handed
    "round" in turn.  They were set content, but not time.]
    
    But American IDs I think use curriculum for the aims.
    	Reigeluth (above):
    Curriculum (what to teach)
    Instruction (how to teach it)  includes:
    	(= design, dev.(create resources?), impl.(adapt to local circs
    =?delivery?)
    Counseling
    Admin.
    Evaluation
    Management
    
    I.e.:
    Syllabus
    Curriculum
    Instructional design / L-design
    
    What does curriculum design mean?
    
    
    Put this on page with 
    C]  L-act/Lactivity hier?  L-object.  cf. like the books of the original
    curric.
    B] curric vs. syllabus (vs. L-aims vs. L-design ...)
    A] ILOs, L-aim, objectives; outcomes, ...
    	It (A&K neoBloom book) also says intended student learning outcomes --
    outcomes = objectives, curriculum standards, learning goals.
    
    


    Last changed 27 Feb 2012 ............... Length about 900 words (6000 bytes).
    (Document started on 29 Jan 2012.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/dalecone.html. You may copy it. How to refer to it.

    Dale's cone, spontaneous misconceptions, fraud

    The bogus "Dale's cone"

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    The issue or phenomenon

    Examples:

    The issue or pheno
    The false cone
    The real cone exists
    The false Confucius
    

    Model 1: random mutation. Scholarship's reasoned rebuttal of the attribution

    Archiv ref: model of random meme.
    Thalheimer etc. doing the scholarship => the attribution (authority) is wrong.
    

    Model 2: Analogy to other pyramids. Theory and experiment's reasoned rebuttal of the assertion

    Bloom, xref my neoBloom.
    Evidence against the presupposition behind the assertions:
    DrFox (even if medium, then motivation X delivery skill)
    NGray: more interesting points about medium use in teaching
    
    Ls don't know how/where they learned (so feeling of recog on seeing the cone
    may be a delusion even about the reader's own experience).
    (DrFox showed) it all depends on whether trying to learn, or just to be
    interested/entertained.
    

    Model 3: Spontaneous misconceptions. The educational theory of the unreasonable endurance of this error

    Other cases: I hear, I see, I do.  I have to create this: doesn't seem to be
    on my joke/quotes page after all.
    
    Huge false attribs.
    
    Viennot, SponCons as the theory of why these recur (not random bad
    scholarship, but an educational reason.)
    They occur in every disc.  E.g. plants feeding through their roots.
    

    Conclusion

  • So model 1 establishing that there is no case to answer because therer never has been any (published, peer reviewed) evidence, and the assertions of authority are all false.
  • Model 2 establishes that if, nevertheless, we were to consider the bogus cone as a hypothesis, then these are several lines of both data and theory suggesting it is probably quite wrong and an unpromising hypothsis to research.
  • Model 3 tells us that nevertheless we are likely to see it perennially asserted because it seems to trigger a powerful though spurious resonance with our experience and attitudes.

    Appendix

    Why is it attractive?
    The truths it falsely seems to express?
    
    Cone / see, hear, do
    Putnam
    Falling asleep when forcing ourselves to read
    Falling asleep over TV but not blaming ourselves
    Falling asleep in conversation but not blaming ourselves
    
    BUT cone has no "thinking" as a mode of learning
    

    References

  • Will Thalheimer:   top of website   page1   page2   page3   page4   A ppt
  • Lalley, J. P. and Miller R. H. (2007) "The Learning Pyramid: Does It Point Teachers in the Right Direction?" Education vol.128 no.1 pp.64-79

    links

  • http://homepages.gold.ac.uk/polovina/learnpyramid/
  • Niamh's report


    Last changed 7 March 2009 ............... Length about 300 words (3,000 bytes).
    (Document started on 10 Sep 2006.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/edgen.html. You may copy it. How to refer to it.

    General Educational Rules

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Background contextual truths for Learning and Teaching

    Never forget to put any current question about the learning and teaching process against the background of some often overlooked truths.


    Last changed 11 May 2012 ............... Length about 6,000 words (42,000 bytes).
    (Document started on 11 Nov 2008.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/edujokes.html. You may copy it. How to refer to it.

    Educational jokes

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    There were two small boys, John and Jim, who were friends. Jim had a dog. One day they were taking the dog for a walk walk and and Jim said proudly: "I've taught the dog to whistle". "What do you mean?", said John, "He's not whistling". "I know", said Jim, "But I said I'd taught him; I didn't say he'd learned".
    Green-Armytage, P. (2002) "Colour Zones -- Connecting colour order and everyday language" 9th Congress of the International Colour Association, Proceedings of SPIE Vol. 4421 pp.976-979

    "I know I've taught it because I've heard myself say it."
    Quoted in K.A.Bruffee (1993)Collaborative learning

    True jokes


  • Here is a 5 min video: "Doodling in Math Class", which is entertaining (rather than a joke). My reflections on what it says about teaching are here.

    Aphorisms

    The whole purpose of education is to turn mirrors into windows. [T10, T333] - Sydney J. Harris

    I pay the schoolmaster, but it is the school boys who educate my son. [T10, T333] - Ralph Waldo Emerson

    The best education consists in immunizing people against systematic attempts at education [T10] - Paul Karl Feyerabend

    The most important outcome of education is to help students become independent of formal education. [T10] - Paul E. Gray President of MIT 1980-90

    Formal education is but an incident in the lifetime of an individual. Most of us who have given the subject any study have come to realize that education is a continuous process ending only when ambition comes to a halt. [T10] - R.I.Rees. One (this one?) Robert Irwin Rees was a Brigadier General, United States Army; and President (1929-1930) of American Society for Engineering Education.

    Whom do I call educated? First, those who manage well the circumstances they encounter day by day. Next, those who are decent and honorable in their intercourse with all men, bearing easily and good naturedly what is offensive in others and being as agreeable and reasonable to their associates as is humanly possible to be... those who hold their pleasures always under control and are not ultimately overcome by their misfortunes... those who are not spoiled by their successes, who do not desert their true selves but hold their ground steadfastly as wise and sober-minded men. [T10] Socrates

    "The things taught in colleges and schools are not an education, but the means of education." [T10] Ralph Waldo Emerson

    "He is to be educated because he is a man, and not because he is to make shoes, nails, and pins." [learning for learning's sake, almost.] [T10] William Ellery Channing (1780-1842) U.S. Unitarian clergyman and writer.

    Everywhere I go I'm asked if I think the university stifles writers. My opinion is that they don't stifle enough of them. There's many a best-seller that could have been prevented by a good teacher. [T10/T6] Mary Flannery O'Connor (1925-1964) American novelist, short-story writer and essayist.

    Education is the ability to listen to almost anything without losing your temper or your self-confidence. [T10] Robert Lee Frost (1874-1963) American poet.

    It is the mark of an educated mind to be able to entertain a thought without accepting it. Aristotle

    An educated man is one who can entertain a new idea, entertain another person and entertain himself. [T10] Sidney Herbert Wood, (UK) principal assistant secretary of the Ministry of Education in a 1947 talk. Reported in Time magazine Monday, May 19, 1947.

    ".. if you work hard and intelligently you should be able to detect when a man is talking rot, and that, in my view, is the main, if not the sole, purpose of education." [T10] [it's all critical thinking] John Alexander Smith, Professor of Moral Philosophy, Oxford University, 1914.

    "Education is the path from cocky ignorance to miserable uncertainty." [T10] Twain

    "Education consists mainly in what we have unlearned." [T10] - Mark Twain's Notebook, 1898

    "All Human Knowledge is precious whether or not it serves the slightest human use." [T10]
    A.E. Housman

    Education is what remains when we have forgotten all that we have been taught. [T10] George Savile, Marquis of Halifax (1633-1695) English statesman and author
    Education is what remains after one has forgotten what one has learned in school. [T10]
    Albert Einstein
    Education is what survives when what has been learnt has been forgotten. [T10, T9] B.F. Skinner, US psychologist New Scientist May 21, 1964

    There are obviously two educations. One should teach us how to make a living and the other how to live. [T10]
    James Truslow Adams (historian, freelance author, Pulitzer prize winner) in "To 'Be' or to 'Do': A Note on American Education" June, 1929 Forum.

    "If you travel with us you will have to learn things you do not want to learn in ways you do not want to learn". [T10]
    [Doris Lessing, from a letter replying to a reader who had been seriously disturbed by reading one of her novels. Quoted in Alan Yentob's "Imagine" TV programme on Doris Lessing, broadcast Tues 27 May 2008, 10:35pm on BBC1]

    "Reading maketh a full man, conference a ready man, and writing an exact man." [T10, T333]
    Francis Bacon (1625) "Of studies" in Essays.   See here and here for copies of Bacon's 1625 essay; and here for Samuel Johnson's 1753 follow-up.


    "Those who can, do; those who can't, teach." [T1]
    George Bernard Shaw in Man and Superman.

    "Those who can, do.
    Those who can't, teach.
    Those who can't teach, teach teachers.
    Those who can't teach teachers, go into politics." [T1]
    Muriel Barbery in The elegance of the hedgehog (2006)

    "Everyone who is incapable of learning has taken to teaching" [T1] Oscar Wilde in The Decay of Lying

    "I like to teach: it's easier than learning." [T1]
    A character says this in John Updike's (1968) Couples
    However still easier than teaching, is just to do the task for the learner. Which is what teachers are continually tempted into.

    However
    "Those who can, do. Those who understand, teach." [T1]
    Or in full:
    "With Aristotle we declare that the ultimate test of understanding rests on one's ability to transform one's knowledge into teaching. Those who can, do. Those who understand, teach."
    Schulman, Lee S. (1986) "Those who understand: knowledge growth in teaching." Educational Researcher vol.15 no.2 pp.4-14


    "I cannot teach anybody anything, I can only make them think." [T2] Socrates

    Education is an admirable thing, but it is well to remember from time to time that nothing that is worth knowing can be taught. [T2] Oscar Wilde The critic as artistp248

    The greatest sign of success for a teacher... is to be able to say, "The children are now working as if I did not exist." [T2] Maria Montessori

    Children have to be educated, but they have also to be left to educate themselves. [T2] Abbe Dimnet Art of Thinking 1928

    There were two small boys, John and Jim, who were friends. Jim had a dog. One day they were taking the dog for a walk walk and and Jim said proudly: "I've taught the dog to whistle". "What do you mean?", said John, "He's not whistling". "I know", said Jim, "But I said I'd taught him; I didn't say he'd learned". [T2]
    Green-Armytage, P. (2002) "Colour Zones -- Connecting colour order and everyday language" 9th Congress of the International Colour Association, Proceedings of SPIE Vol. 4421 pp.976-979

    "The power of instruction is seldom of much efficacy except in those happy dispositions where it is almost superfluous." [T2] - Edward Gibbon (1776) The decline and fall of the Roman empire vol.1 ch.4

    I am always ready to learn although I do not always like being taught. [T2]Winston Churchill

    Confucius said: "I am a transmitter, rather than an original thinker. I trust and enjoy the teachings of the ancients. In my heart I compare myself to old Peng." [T2 !]Confucius

    You can teach a student a lesson for a day; but if you can teach him to learn by creating curiosity, he will continue the learning process as long as he lives. [T22?] [but how non-applicable to imagine a) that you can create curiosity about anything anytime; b) that a student is well-equipped if they can only learn when curious, not when it is useful to them or required by others] Clay P. Bedford [? a top executive of Kaiser Industries in California, died 1991]

    "Knowledge which is acquired under compulsion obtains no hold on the mind." Plato, from The Republic [T22]

    Spoon feeding in the long run teaches us nothing but the shape of the spoon. [T22] E.M.Forster from a radio talk.


    Education is one of the chief obstacles to intelligence and freedom of thought [T3, (T6)] Bertrand A. Russell

    Education makes us more stupid than the brutes. A thousand voices call to us on every hand, but our ears are stopped with wisdom. [T3] - Jean Giraudoux

    Learning: the kind of ignorance distinguishing the studious. [T3] Ambrose Bierce The Devil's Dictionary

    "I have never let my schooling interfere with my education." [T3] - This quote has been attributed to Mark Twain, but until the attribution can be verified, the quote should not be regarded as authentic.
    "Don't let school interfere with your education" [T3]
    "Never let formal education get in the way of your learning." [T3] [may be the accurate one.]

    My grandmother wanted me to have an education, so she kept me out of school. [T3] Margaret Mead

    "A little learning is a dangerous thing; drink deep, or taste not the Pierian spring: there shallow draughts intoxicate the brain, and drinking largely sobers us again." [T3]
    Alexander Pope (1688-1744) in An Essay on Criticism (1709)

    "'Only I was afraid you would be getting so learned', said Celia, regarding Mr. Casaubon's learning as a kind of damp which might in due time saturate a neighbouring body." [T3]
    George Eliot in ch.28 of Middlemarch (1871)

    For as the Greek verse says: 'To what use serves learning, if understanding be away.' [T3] Apud Stobaeus, tit. iii., p. 37 (1609); quoted in Montaigne On pedantry On pedantry

    I do not approve of anything that tampers with natural ignorance. Ignorance is like a delicate exotic fruit; touch it and the bloom is gone. The whole theory of modern education is radically unsound. Fortunately in England, at any rate, education produces no effect whatsoever. If it did, it would prove a serious danger to the upper classes, and probably lead to acts of violence in Grosvenor Square. [T3]
    Wilde,Oscar The importance of being earnest

    "He who learns without thinking will be bewildered; he who thinks without learning will be in danger." [T3] - Confucius

    All intellectual improvement arises from leisure. [T3, T8] Samuel Johnson in Boswell (1799): Life of Johnson [N.B. Johnson is using this as an argument for social inequality]

    "Knowledge is good, method is good, but one thing beyond all others is necessary; and that is to have a head, not a pumpkin, on your shoulders, and brains, not pudding, in your head." [T33]
    A.E. Housman

    No one wants a good education. Everyone wants a good degree. [T33] - Lee Rudolph

    The Master said, "In ancient times, men learned with a view to their own improvement. Nowadays, men learn with a view to the approbation of others." [T33] - Confucius [This shows that an imaginary nostalgia for deep over shallow learning, or at least for intrinsic over extrinsic motivation, for learning was present even in ancient times.]

    Education is a state-controlled manufactury of echoes. [T33] Norman Douglas, (probably the English author, died 1952)

    He who joyfully marches to music in rank and file has already earned my contempt. He has been given a large brain by mistake, since for him the spinal cord would suffice. [T33/T6] Einstein


    Do we really recommend learning from your errors?
    Here's a quote from an experimental astrophysicist as his team slaves away getting their balloon-borne telescope ready for launch:
    "Step by tedious step, we stumble away from abject failure. And that's on a good day." [T4]
    Barth Netterfield, in a TV documentary on one of his research projects

    "Only a fool learns from his own mistakes. The wise man learns from the mistakes of others." [T4] Otto von Bismarck

    If you want to increase your success rate, double your failure rate. [T4] Thomas Watson, Sr., founder of IBM

    "For the things we have to learn before we can do them, we learn by doing them." [T4] Hannah Arendt

    Mistakes are the portals of discovery. [T4] James Joyce Ulysses

    Learning is like raising a monument; if I stop with this basket of earth, it is my own fault. It is like throwing earth on the ground; one basket at a time, yet I advance. [T4] - Confucius

    I never make stupid mistakes. Only very, very clever ones. [T4] John Peel, disc jockey

    The only thing experience teaches us is that experience teaches us nothing. [T4] Andre Maurois (1885-1967) French biographer and writer

    Time is a great teacher, but unfortunately it kills all its pupils [T4] (Louis) Hector Berlioz .


    "Poor is the pupil who does not surpass his master." [T5]
    Leonardo da Vinci

    If the student isn't better than the teacher, then the teacher is a failure. [T5]
    Zen aphorism, quoted by Allen Ginsberg

    I am entirely certain that twenty years from now we will look back at education as it is practiced in most schools today and wonder that we could have tolerated anything so primitive. [T5] - John W. Gardner, Secretary of Health, Education, and Welfare under President Lyndon Johnson.

    "The plural of anecdote is not data" [T7] Lee Shulman.

    "It was imagined that experiments in education were not necessary; and that, whether any thing in it was good or bad, could be judged of by the reason. But this was a great mistake; experience shows very often that results are produced precisely the opposite to those which had been expected. We also see from experiment that one generation cannot work out a complete plan of education." [T7] Immanuel Kant, in his university lectures On Pedagogy


    Only dead fish swim with the stream. [T6] Malcolm Muggeridge

    No one can possibly achieve any real and lasting success or 'get rich' in business by being a conformist. [T6] [but untrue] John Paul Getty

    The imagination imitates. It is the critical spirit that creates. [T6] Oscar Wilde

    "The principal goal of education is to create men who are capable of doing new things, not simply of repeating what other generations have done." [T6] Jean Piaget

    Thank goodness I was never sent to school; it would have rubbed off some of the originality. [T6] Beatrix Potter (1866-1943) English author, illustrator, mycologist and conservationist.


    Education costs money, but then so does ignorance. [T8] - Sir Claus Moser (b. 1922), German-born British academic and statistician, Warden of Wadham College, Oxford. Daily Telegraph (London, 21 Aug. 1990).

    If a man empties his purse into his head, no one can take it away from him. An investment in knowledge always pays the best interest. [T8] Benjamin Franklin
    [N.B. this doesn't say that formal education is the best investment.]

    All intellectual improvement arises from leisure. [T3, T8] Samuel Johnson in Boswell (1799): Life of Johnson [N.B. Johnson is using this as an argument for social inequality]

    There can be no education without leisure, and without leisure education is worthless. [T8] Sarah Josepha Hale (American writer, author of "Mary had a little lamb", died 1879)

    Otium sine litteris mors. (Leisure without learning [is] death) [T8] Seneca (AD 65) Moral Epistle 82

    One of the few things a person is willing to pay for and not get. [T8] William Lowe Bryan, 10th president of Indiana University (1902 to 1937).

    Education seems to be in America the only commodity of which the customer tries to get as little he can for his money. [T8] Max Leon Forman (1909-1990) Jewish-American writer

    We learn simply by the exposure of living. Much that passes for education is not education at all but ritual. The fact is that we are being educated when we know it least. [T9] - David P. Gardner [who is he?]

    You know more than you think you know, just as you know less than you want to know. [T9] Oscar Wilde

    Education is what survives when what has been learnt has been forgotten. [T10, T9] B.F. Skinner, US psychologist New Scientist May 21, 1964 [i.e. you believe you have forgotten, yet you show permanent changes.]

    The fellow who thinks he knows it all is especially annoying to those of us who do. [T9] Harold Coffin, a former humor columnist for The Associated Press, died 1981


    Docendo discimus: By teaching, we learn. [T333] Seneca (AD 65) Moral Epistles 1, 7, 8

    More important than the curriculum is the question of the methods of teaching and the spirit in which the teaching is given. [T333] Bertrand Russell

    "Teaching yourself is discovering what is teachable." [T333]
    From: "For me, the first challenge for computing science is to discover how to maintain order in a finite, but very large, discrete universe that is intricately intertwined. And a second, but not less important challenge is how to mould what you have achieved in solving the first problem, into a teachable discipline: it does not suffice to hone your own intellect (that will join you in your grave), you must teach others how to hone theirs. The more you concentrate on these two challenges, the clearer you will see that they are only two sides of the same coin: teaching yourself is discovering what is teachable."
    E.W.Dijkstra.
    [N.B. This distinguishes implicit and explicit. If it's implicit, you may have learned it, but can't teach it -- at least in Dijkstra's view of teaching here.]

    The greatest education in the world is watching the masters at work. [T333] - Michael Jackson (the pop star) in Moonwalk, 2009

    First figure out why you want the students to learn the subject and what you want them to know, and the method will result more or less by common sense. [T333] - Richard Feynman

    "solution to the problem of education":
    I think, however, that there isn't any solution to this problem of education other than to realize that the best teaching can be done only when there is a direct individual relationship between a student and a good teacher -- a situation in which the student discusses the ideas, thinks about the things, and talks about the things. It's impossible to learn very much by simply sitting in a lecture, or even by simply doing problems that are assigned. [T333] - Richard Feynman

    I learned most, not from those who taught me but from those who talked with me. [T333] - St. Augustine

    I pay the schoolmaster, but it is the school boys who educate my son. [T10, T333] - Ralph Waldo Emerson

    It appears, therefore, that some development of the capacity to be alone is necessary if the brain is to function at its best, and if the individual is to fulfil his highest potential. Human beings easily become alienated from their own deepest needs and feelings. Learning, thinking, innovation and maintaining contact with one's own inner world are all facilitated by solitude. - Anthony Storr

    "By three methods we may learn wisdom: First, by reflection, which is noblest; Second, by imitation, which is easiest; and third by experience, which is the bitterest." [T333] - Confucius

    I used to sit alone thinking about this and that. Sometimes I even forgot my meals or bedtime. Still I gained very little. Later I shifted to reading omnivorously, but I did not benefit a great deal either. At long last I came to see that reading in a mechanical way without using my brains was no use. On the other hand, if thinking is divorced from the reality and no due attention is paid to reading, one will continue to feel puzzled by many things. One should constantly review what he has learned and combine reading with thinking. In thus making use of the theories one has learned to guide his thought and help analyze the problems at hand, progress will be achieved. [T333] - Confucius

    It matters not what you Learn; but when you once learn a thing, you must never give it up until you have mastered it. It matters not what you inquire into; but when you inquire into a thing, you must never give it up until you have thoroughly understood it. It matters not what you try to think out, but when you once try to think out a thing, you must never give it up until you have got what you want. It matters not what you try to sift; but when you once try to sift out a thing, you must never give it up until you have sifted it out clearly and distinctly. It matters not what you try to carry out; but when you once try to carry out a thing, you must never give it up until you have done it thoroughly and well. [T333] - Confucius

    "A student should not be taught unless he is anxious to understand what he does not understand, and should not be enlightened unless he is eager to express what he cannot express." [T333] - Confucius. [the recipe for getting learners to recognise a problem.]

    "Letting the students admire the excellence of other students ensures the success of education." [T333] - Confucius [My L3 tutorial reciprocal critiquing exercise.]

    "Is it not a pleasure to learn and practise from time to time what is learned?" [T333] - Confucius

    Correction does much, but encouragement does more. [T333] - Goethe

    Those who trust us educate us. [T333] - George Eliot

    Nine tenths of education is encouragement. [T333] - Anatole France
    [Cf. Mitra.]

    Reviewing what you have learned and learning anew, you are fit to be a teacher. [T222] - Confucius

    He can be a teacher who finds what is new in reviewing what is old. [T222] - Confucius


    Confucius

    Confucius is the Latin form of K'ung-Fu-tze (Master Kong). 550BC - 478BC or 551-479BC in /near Shantung. Contemporary of Buddha; 100 years before Plato.

    There are five collections of writings by Confucius and his disciples: The analects of Confucius,   The great learning,   The doctrine of mean,   Mencius;   The book of change,   The book of odes,   The book of rites,   The book of history,   The spring and autumn annals.

  • Analects.
  • A.C.Muller's (1990, 2011) translation
  • Another page
  • Other sayings

    [analect 7:1] Confucius said: "I am a transmitter, rather than an original thinker. I trust and enjoy the teachings of the ancients. In my heart I compare myself to old Peng." [T2]

    [analect 7:2] Confucius said: "Keeping silent and thinking; studying without satiety, teaching others without weariness: these things come natural to me."

    "By three methods we may learn wisdom: First, by reflection, which is noblest; Second, by imitation, which is easiest; and third by experience, which is the bitterest."

    "A student should not be taught unless he is anxious to understand what he does not understand, and should not be enlightened unless he is eager to express what he cannot express." [the recipe for getting Ls to recognise a problem.]

    Student Teams "Letting the students admire the excellence of other students ensures the success of education." [My L3 tutorial reciprocal critiquing exercise.]

    Tutorials "Is it not a pleasure to learn and practise from time to time what is learned?"

    Confucius said: "Isn't it a pleasure to study and practise what you have learned?

    The Master said, "In ancient times, men learned with a view to their own improvement. Nowadays, men learn with a view to the approbation of others." [This shows that an imaginary nostalgia for deep over shallow, or at least for intrinsic over extrinsic motivation for learning was present even in ancient times.]

    The Master said, "Learning without thought is labor lost; thought without learning is perilous."

    "I used to sit alone thinking about this and that. Sometimes I even forgot my meals or bedtime. Still I gained very little. Later I shifted to reading omnivorously, but I did not benefit a great deal either. At long last I came to see that reading in a mechanical way without using my brains was no use. On the other hand, if thinking is divorced from the reality and no due attention is paid to reading, one will continue to feel puzzled by many things. One should constantly review what he has learned and combine reading with thinking. In thus making use of the theories one has learned to guide his thought and help analyze the problems at hand, progress will be achieved. " [T333]

    Confucius said: "Reviewing what you have learned and learning anew, you are fit to be a teacher."
    [T333] [Comment] Confucian "learning" is always fully connected to self-transformation.

    Every truth has four corners: as a teacher I give you one corner, and it is for you to find the other three. [is this genuine?]

    "In education there are no class distinctions" [widening participation]

    "Is it not pleasant to learn with a constant perseverance and application? ...

    Tsze-hsia said, "There are learning extensively, and having a firm and sincere aim; inquiring with earnestness, and reflecting with self-application: -- virtue is in such a course."

    The capacity for knowledge of the inferior man is small and easily filled up; the intelligence of the superior man is deep and not easily satisfied.

    It matters not what you Learn; but when you once learn a thing, you must never give it up until you have mastered it. It matters not what you inquire into; but when you inquire into a thing, you must never give it up until you have thoroughly understood it. It matters not what you try to think out, but when you once try to think out a thing, you must never give it up until you have got what you want. It matters not what you try to sift; but when you once try to sift out a thing, you must never give it up until you have sifted it out clearly and distinctly. It matters not what you try to carry out; but when you once try to carry out a thing, you must never give it up until you have done it thoroughly and well.

    THE TRUE SCHOLAR When the opportunity of gain is presented to him, he thinks on virtue. He is reverent in sacrifice; in mourning, absorbed in the sorrow he should feel. He who cherishes love of comfort is not fit to be a scholar.

    The main object of study is to unfold the aim; with one who loves words, but does not improve, I can do nothing.

    The scholar's burden is perfection; is it not heavy? It ends but with life; is it not enduring?

    Learning is like raising a monument; if I stop with this basket of earth, it is my own fault. It is like throwing earth on the ground; one basket at a time, yet I advance.

    The true scholar is not a mere utensil. Leaving Virtue without proper culture; failing thoroughly to discuss what is Learned; being unable to move toward the righteousness of which knowledge is gained; and being unable to change what is not good, -- these are the things that (in my scholars) give me anxiety.

    If a man keeps cherishing his old knowledge, so as ever to acquire new, he may be a teacher of others. I marked Yen-Yuen's constant advance; I never saw him pause. Often the blade springs, but the plant does not go on to flower; often the plant flowers, but produces no fruit.

    Having completed his studies, the scholar should devote himself to official functions. He should say : "I am not concerned that I have no place; I am concerned how I shall fit myself for one. I am not concerned at not being known; I seek to be worthy to be known."

    "Knowing without doing is not knowing."

    "He who learns without thinking will be bewildered; he who thinks without learning will be in danger."

    "He can be a teacher who finds what is new in reviewing what is old."


    Oscar Wilde

    Wilde,Oscar The importance of being earnest Act 1. Jack: "I know nothing, Lady Bracknell." LB: "I am pleased to hear it. I do not approve of anything that tampers with natural ignorance. Ignorance is like a delicate exotic fruit; touch it and the bloom is gone. The whole theory of modern education is radically unsound. Fortunately in England, at any rate, education produces no effect whatsoever. If it did, it would prove a serious danger to the upper classes, and probably lead to acts of violence in Grosvenor Square." [T3]

    Everybody who is incapable of learning has taken to teaching. [T1]

    Education is an admirable thing, but it is well to remember from time to time that nothing that is worth knowing can be taught. [T2]

    I like talking to a brick wall, it's the only thing in the world that never contradicts me. []

    The mind of the thoroughly well-informed man is a dreadful thing. It is like a bric-a-brac shop, all monsters and dust, with everything priced above its proper value. []

    I love talking about nothing. It is the only thing I know anything about. [exams!]

    You know more than you think you know, just as you know less than you want to know. [T9]

    Life is too short to learn German []

    I may have said the same thing before... But my explanation, I am sure, will always be different.

    Examinations, sir, are pure humbug from beginning to end. If a man is a gentleman, he knows quite enough, and if he is not a gentleman, whatever he knows is bad for him. - Lord Fermor, in The Picture of Dorian Gray (1891) by Oscar Wilde.


    Benjamin Franklin [Refs to be checked.]

    A learned blockhead is a greater blockhead than an ignorant one.

    An investment in knowledge pays the best interest.
    Experience keeps a dear school, but fools will learn in no other.
    I guess I don't so much mind being old, as I mind being fat and old.
    If a man empties his purse into his head, no one can take it from him.

    Tell me and I forget. Teach me and I remember. Involve me and I learn.


    Some links

  • http://www.ntlf.com/html/lib/quotes.htm Has citations
  • http://www.quotationspage.com/quote/904.html Has citations
  • http://www.motivationalquotes.com/pages/education-quotes.html
  • http://www.1-funny-quotes.com/funny-learning-quotes.html
  • http://www.mylinkstolearning.com/teachqts.htm
  • http://www.1-famous-quotes.com/quote/555048
  • Mark Twain quotes on education
  • http://www.cybernation.com/victory/quotations/subjects/quotes_education.html
  • http://www.fun4biz.com/coach/coach/learning_quotes_humorous.html
  • http://quotationsbook.com/quote/23103/
  • Quotations book
  • Feynman on teaching
  • Preface on teaching to Feynman's Lectures
  • http://www.etni.org.il/quotes/education.htm
  • http://www.lhup.edu/~dsimanek/eduquote.htm
  • http://isgwww.cs.uni-magdeburg.de/~graham/quotes/educationis.html
  • http://www.nea.org/grants/35593.htm
  • http://www.quotedb.com/quotes/899
  • http://www.home-education.org.uk/resources-quotes.htm
  • http://www.famouslifemottos.org/Education.html
  • http://www.lightafire.com/quotations/authors/clay-p-bedford/
  • http://faculty.darden.virginia.edu/brunerb/case-student.htm
  • http://www.wisdomword.info/benjamin-franklin/

    Tags / classifications

  • Project to support crowd-sourcing of citation verification

  • T10 The nature / aims of education ...
  • T1 If you can't do then teach .... (N.B. do, learn, teach, teach-Ts, politician: that direction implies (mockingly) decreasing ability, but if you believe in constructivism then the difficulty runs right to left.)
  • T2 Constructivism // teaching isn't possible // good teaching
  • T22 Bad teaching
  • T222 Good teaching
  • T3 (education) What is bad about education (learning vs. educ.)
  • T33 Bad learning
  • T333 Good learning
  • T4 Trial and error / Learning by exploration
  • T5 Progress at teaching, at learning and teaching
  • T7 The need for educational research (not just doing whatever occurs to)
  • T6 Imagination, creativity (cf. Ken Robinson) (Why? because naturally we only like assimilation. Education gets you practised and confident with accommodation. Accomodation means diminished doing (performance), but better learning.)
  • T8 Money: is education worth paying for?
  • T9 Metamemory / meta-knowledge: self awareness about whether you remember/know something.


    Last changed 25 Mar 2011 ............... Length about 900 words (6000 bytes).
    (Document started on 25 Mar 2011.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/effect.html. You may copy it. How to refer to it.

    Effect size

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    This page is about effect size: what it is in a slightly wider perspective than just statistics. If you just want the statistical view and tests, the wikipedia page seems good.

    Whereas statistical tests such as a t-test aim to tell you what degree of certainty to attribute to a difference (an effect), another important question is "How important is that difference (if real)?". I shall use the term "effect size" as a general title for this question; and take particular statistical tests of effect size (e.g. "Cohen's d") to be just one interpretation of the question.

    Some different senses of "how important"

    Basic approach: StdDev units

    How much of the variance is explained

    xx

    xx

    New Sci, Gender effects table


    Last changed 15 July 2009 ............... Length about 4,000 words (25,000 bytes).
    (Document started on 18 May 2009.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/gibson.html. You may copy it. How to refer to it.

    Gibson, Affordance

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    There have been discussions on what J.J.Gibson means for visual perception, for the notion of affordance in HCI, and for the notion of affordance in e-learning. We all have enormous trouble integrating his ideas with our habitual ones, and the more we are trained (indoctrinated) in computer programming and reductionist "science" the more trouble we have. A number of authors have attempted to define and redefine terms like "affordance". Normally, I am strongly drawn to this kind of approach. But the trouble is that when we attempt to define a term, we fall back almost entirely unconsciously on existing patterns of thought, and do not even consider giving up anything we already believe. Gibson however constitutes a challenge to some of our patterns of thought.

    I think the simplest short thing we can do is to list some basic lessons Gibson taught: whenever we write something inconsistent with these, then we are showing our prejudices in ways that are incompatible with the real world (as well as with Gibson's ideas, which aren't necessarily right in all ways). Here's my list of such Gibson inspired points, or facts.

    Comments, HCI, Education

    Oliver, Dohn and others have commented on the problems with people's definitions of "affordance" in the fields of HCI and Education (especially technology and education). They try to do conceptual analysis, and to connect the concept with philosophical concepts. I'm going to leave them to it because I don't find their papers illuminating of educational issues. Following my comments above I'm going to:

    Here goes.

    Gibson's ideas thus give us 4 useful things for pushing forward our ideas about education:

    References

    Benjamin S. Bloom (1984) "The 2 Sigma Problem: The Search for Methods of Group Instruction as Effective as One-to-One Tutoring" Educational Researcher Vol.13, No.6, pp.4-16

    Biggs ch.

    Carroll, J.B. (1989) "The Carroll model: A 25 year retrospective and prospective view" Educational Researcher vol.18 no.1 pp.26-31.

    Dohn, N.B. (2009) "Affordances revisited: Articulating a Merleau-Pontian view" Computer supported learning vol.4 pp.151-170

    Oliver,M. (2005) "The problem with affordance" E-learning vol.2 no.4 pp.402-413.


     

    The Dead Grandmother/Exam Syndrome and the Potential Downfall Of American Society.

    Mike Adams, Biology Department
    Eastern Connecticut State University
    The Connecticut Review, 1990

    This is a copy from http://www.cis.gsu.edu/~dstraub/Courses/Grandma.htm
    which was a copy from http://biology.ecsu.ctstateu.edu/People/ConnRev
    which has now moved to http://nutmeg.easternct.edu/~adams/Resources/Grannies.pdf

    It has long been theorized that the week prior to an exam is an extremely dangerous time for the relatives of college students. Ever since I began my teaching career, I heard vague comments, incomplete references and unfinished remarks, all alluding to the "Dead Grandmother Problem." Few colleagues would ever be explicit in their description of what they knew, but I quickly discovered that anyone who was involved in teaching at the college level would react to any mention of the concept. In my travels I found that a similar phenomenon is known in other countries. In England it is called the "Graveyard Grannies'' problem, in France the "Chere Grand'mere," while in Bulgaria it is inexplicably known as "The Toadstool Waxing Plan" (I may have had some problems here with the translation. Since the revolution this may have changed anyway.) Although the problem may be international in scope it is here in the USA that it reaches its culmination, so it is only fitting that the first warnings emanate here also.

    The basic problem can be stated very simply: A student's grandmother is far more likely to die suddenly just before the student takes an exam, than at any other time of year.

    While this idea has long been a matter of conjecture or merely a part of the folklore of college teaching, I can now confirm that the phenomenon is real. For over twenty years I have collected data on this supposed relationship, and have not only confirmed what most faculty had suspected, but also found some additional aspects of this process that are of potential importance to the future of the country. The results presented in this report provide a chilling picture and should waken the profession and the general public to a serious health and sociological problem before it is too late.

    As can be seen in Table 1, when no exam is imminent the family death rate per 100 students (FDR) is low and is not related to the student's grade in the class. The effect of an upcoming exam is unambiguous. The mean FDR jumps from 0.054 with no exam, to 0.574 with a mid-term, and to 1.042 with a final, representing increases of 10 fold and 19 fold respectively. Figure 1 shows that the changes are strongly grade dependent, with correlation coefficients of 0.974 for mid-terms and 0.988 for finals. Overall, a student who is failing a class and has a final coming up is more than 50 times more likely to lose a family member than an A student not facing any exams.

     

     

    Current Grade

     

    Next exam

     

    A

     

    B

     

    C

     

    D

     

    F

     

    Mean

     

    None

     

    0.04

     

    0.07

     

    0.05

     

    0.05

     

    0.06

     

    0.054

     

    Mid-term

     

    0.06

     

    0.21

     

    0.49

     

    0.86

     

    1.25

     

    0.574

     

    Final

     

    0.09

     

    0.41

     

    0.96

     

    1.57

     

    2.18

     

    1.042

  •  

    Table 1: The mean number of family deaths/100 students for periods when no exam is coming up, the week prior to a mid-term exam and the week prior to finals. Values are corrected for the number of students in each grade class and the relative frequency of mid-terms and finals.

  •  

  •  

    Figure 1. Graph of data in Table 1, showing the relationship between exam, student grade and FDR. The equation for the simple linear regression on each is shown, as is the correlation coefficient.

     

  • Only one conclusion can be drawn from these data. Family members literally worry themselves to death over the outcome of their relatives' performance on each exam. Naturally, the worse the student's record is, and the more important the exam, the more the family worries; and it is the ensuing tension that presumably causes premature death. Since such behavior is most likely to result in high blood pressure, leading to stroke and heart attacks, this would also explain why these deaths seem to occur so suddenly, with no warning and usually immediately prior to the exam. It might also explain the disproportionate number of grandmothers in the victim pool, since they are more likely to be susceptible to strokes. This explanation, however, does not explain why grandfathers are seldom affected, and clearly there are other factors involved that have not been identified. Nonetheless, there is considerable comfort to be had in realizing that these results indicate that the American family is obviously still close-knit and deeply concerned about the welfare of individual members, perhaps too much so. As some colleagues have expressed some degree of skepticism over my interpretation of these data, I have extended the scope of my research into the phenomenon. Using readily available sources (including the National Census Bureau and The National Enquirer ) have examined the relationship between education and family structure. Interestingly, there appears to be no correlation between FDR and the size of the extended family (Table 2). Either large families worry less on a per capita basis than do small families, or there is a single "designated worrier" in each family, who bears the brunt of the danger. The exceptionally high death rate among grandmothers (24 times greater than for grand fathers) suggests the latter explanation is correct. If not, then people from very small families would be well advised to discourage other family members from attending college, since the potential risk becomes excessive with so few members to share the danger.

    Number in family, excluding student

    0
    1
    2-3
    4-8
    8-15
    16-30
    30+
    Mean FDR
    <0.01
    0.66
    0.71
    0.62
    0.73
    0.64
    0.68

  •  

    Table 2. Mean FDR for all exam periods and all student GPAs over the last decade. Families ranging in size from 1-30+ show no significant correlation (0.04) between family size and FDR. The figure for students with no family would have been zero, except for a single family-less student (a member of the baseball team) who tragically lost at least one grandmother every semester for four years.

     

  • The problem is clearly far more pervasive than most people realize. For example, if one examines the percentage of the population attending college and the mean divorce rate on a country by country basis, there is a very strong positive correlation between the two. The United States has the highest percentage of its population attending college and also the world's highest divorce rate, while South Yemen is last in both categories. Although this study is still in progress and will form the basis for a future CSU grant proposal, it seems results already are becoming clear. As more people go to college, their families find that, for safety reasons, it is wise to increase the number of grandmothers per family. Since there is currently no biological way of doing so (though another grant proposal in preparation will ask for funds to look into the prospect of cloning grandmothers, using modern genetic engineering techniques), the families must resort to in creasing the pool by divorce and remarriage. Sociologists may wish to use these data to examine the effect of education on family structure from a new perspective.

     

    Figure 2: The mean FDR/100 students for all exams and all grades of students for the years 1968-1988. The best fitting curve shows an exponentially rising curve, with the equation shown in the figure.

     

     

    While the general facts of this problem have been known, if not widely discussed, I have recently become aware of a potentially far more dangerous aspect of the whole process. This trend came to light when a student reported two family members dying prior to an exam. Examination of the numbers of deaths over the last two decades clearly showed a "death inflation" When the figures for all students and all exams are pooled for each year, a disturbing outcome is seen (see Figure 2).

    The FDR is climbing at an accelerating rate. Extrapolation of this curve suggests that 100 years from now the FDR will stand at 644/100 students/exam. At that rate only the largest families would survive even the first semester of a student's college career. Clearly something will have to be done to reverse this trend before the entire country is depopulated. Three possible solutions come to mind:

    1. Stop giving exams. At first glance, this seems to be the simplest answer to the problem. Like many simplistic solutions, however, it fails to consider the full ramifications of such a course. Without exam results, all medical schools would be forced to close their doors, having no way of distinguishing worthy students. The resultant dearth of physicians in the next generation would throw so many other professionals (tax accountants, malpractice attorneys, golf pros, etc.) out of work that the economy would go into a nosedive. Regretfully, this solution must be abandoned since it is more dangerous than the original problem.

    2. Allow only orphans to enroll at universities. This is an extremely attractive idea, except for the shortage of orphans. More could be created of course, but this would be morally wrong, and in any case would replicate the very problem we are trying to avoid i.e. excessive family deaths.

    3. Have students lie to their families. Students must never let any of their relatives know that they are at university. (Initial field tests show that keeping just the grandmother ignorant is neither feasible nor safe for the rest of the family.) It is not enough merely to lie about exams; if the family doesn't know when the exams are, they may then worry constantly and this may lead to even higher death rates. The only solution is that the family must never be aware that the student is even enrolled at a university. Students must pretend they are in the armed forces, have joined some religious cult, or have been kidnapped by aliens. All of these alternate explanations for their long absences will keep the family ignorant of the true, dangerous, fact. Although it might be argued that such large-scale deceptions could not be maintained for long periods, the success of many politicians suggests otherwise.

    It will take time to discover whether any of these solutions are feasible. In the interim, the problem is clearly far too important to be ignored. Following the government's lead on so many similar, potentially catastrophic problems (global warming, the ozone layer, and ocean pollution), I propose that a commission be established to study the problem in more depth. While the state is deciding on the make-up of such a committee and what its charge should be, I would urge all members of the academic community to start keeping their own records. If faculty throughout the country were to send me summaries of their own knowledge about this matter, I could compile a follow-up report for publication in a year or two.


    Last changed 11 Sep 2006 ............... Length about 600 words (6,000 bytes).
    (Document started on 10 Sep 2006.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/informal.html. You may copy it. How to refer to it.

    Informal learning

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Formal learning is doing a course for accreditation in an institution. What is informal learning? Several dimensions.

    List 2: Independent dimensions?

    List 1


    Last changed 5 Aug 2009 ............... Length about 200 words (2000 bytes).
    (Document started on 5 Aug 2009.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/medical.html. You may copy it. How to refer to it.

    Good online medical help

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    The issue is: where can you trust online for medical advice? New Scientist had an article based on published studies reviewing medical quality of online sites. That plus another pointer are listed here.

  • wikipedia in fact was found to have high accuracy on medical matters, with the possible problem being incompleteness (not just in coverage, but in mentioning possible side effects or drug interactions).
  • medlineplus.gov USA national library of medicine
  • www.nhs.uk
  • www.nhsdirect.nhs.uk
  • mayoclinic.com Mayo clinic (non-profit organisation)
  • www.webmd.com Written and reviewed by doctors
  • www.healthtalkonline.org Unlike the others, gives what it feels like for the patient and relatives.


    Last changed 31 May 2011 ............... Length about 900 words (6000 bytes).
    (Document started on 31 May 2011.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/mistakes.html. You may copy it. How to refer to it.

    Pros and cons of mistakes

    By Steve Draper,   Department of Psychology,   University of Glasgow.


    Last changed 31 Aug 2011 ............... Length about 200 words (2,000 bytes).
    (Document started on 23 Aug 2010.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/newthoughts.html. You may copy it. How to refer to it.

    Thoughts for the day

    By Steve Draper,   Department of Psychology,   University of Glasgow.

  • Time management: "... the tumult and boredom of everyday life -- itself an unceasing and futile pursuit, consumed by plans"

  • "Our job is not to be teacherly, but enabling"

  • What if they drop out after a year? Will they have 0.25 of each graduate attribute?

  • Sarcasm at work: "How are you?" "Exhausted from happiness."


    Last changed 15 Feb 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 15 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/null.html. You may copy it. How to refer to it.

    Proving a real no difference

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Absence of evidence is not evidence of absence.
    
    How to show no-difference convincingly.
    


    Last changed 7 Oct 2010 ............... Length about 900 words (4,000 bytes).
    (Document started on 6 Oct 2010.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/papers.html. You may copy it. How to refer to it.

    Favourite papers

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    This page is about various collections of very best / favourite published papers.

    Jo Ferrie's favourite papers in/on qualitative research

    My favourite Education papers

    The biggest published effects in Education

    Chick sex Mazur Hake (bloom 1:1 tut)

    Not so much best, as illustrating quite different experimental logics

    xxx


    Last changed 25 July 2010 ............... Length about 300 words (3,000 bytes).
    (Document started on 24 July 2010.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/pexp.html. You may copy it. How to refer to it.

    Patient experience, medical education, public health

    By Steve Draper,   Department of Psychology,   University of Glasgow.


    Last changed 26 Oct 2005 ............... Length about 200 words (2,000 bytes).
    (Document started on 21 Dec 2004.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/tandlpics.html. You may copy it. How to refer to it.

    When pictures are worth more than words

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    A rare case where pictures actually do tell a story without a single word.

    splash 1 splash 2 splash 3


    Last changed 24 April 2010 ............... Length about 300 words (4,000 bytes).
    (Document started on 6 Feb 2007.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/pos.html. You may copy it. How to refer to it.

    Public health approaches to mental illness

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    This is just a brief note on the growing attempts to apply a public health approach to mental health i.e. avoid slow, expensive, and ineffective psychiatrists, and get people's better awareness of the issues to improve health. It is also broadly related to positive psychology.

    Public mental health

    In general, the biggest saving of human life and health have not come from improvements in treatments by doctors and hospitals, but by "public health" measures that prevent disease: clean water, sewage systems, vaccination programmes. Recently the idea has emerged that a similar approach to mental disease might work far better than the current system of slow, expensive, and not very effective treatment by specialists.

    An impressive study showing this reported a reduction in suicide rate of 33% from a series of such "educational" measures:
    Kerry L Knox, David A Litts, G Wayne Talcott, Jill Catalano Feig & Eric D Caine (2005) "Risk of suicide and related adverse outcomes after exposure to a suicide prevention programme in the US Air Force: cohort study" British Medical Journal vol/no.327 p.1376 pp. 20 Dec 2005. doi:10.1136/bmj.327.7428.1376

    There is some local research in this area:   1   2   3

  • Self-help for depression

  • robo therapy
  • Self-help podcasts from the university student counselling service.


    Last changed 26 Mar 2008 ............... Length about 900 words (6000 bytes).
    (Document started on 26 Mar 2008.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/qandq.html. You may copy it. How to refer to it.

    Quantitative vs. Qualitative

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    My real position is that Quantitative vs. Qualitative is not quite the right way of posing the issue (see here).

    However here's a great quote anyway:
    "In physical science the first essential step in the direction of learning any subject is to find principles of numerical reckoning and practicable methods for measuring some quality connected with it. I often say that when you can measure what you are speaking about, and express it in numbers, you know something about it; but when you cannot measure it, when you cannot express it in numbers, your knowledge is of a meagre and unsatisfactory kind; it may be the beginning of knowledge, but you have scarcely in your thoughts advanced to the state of Science, whatever the matter may be."
    Lord Kelvin, PLA, vol. 1, "Electrical Units of Measurement", 1883-05-03


    19 Sept 2010 ............... Length about 1200 words (9,000 bytes).
    (Document started on 10 Sep 2006.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/reflection.html. You may copy it. How to refer to it.

    Dimensions of reflection

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Reflection is a significant concept in education, partly because it is a compulsory component of some courses; and partly because almost all of us assume that if we only think hard and carefully about something we do, then we will get better at it. However I have seen no evidence that this belief is justified; and furthermore, it is far from clear that people mean the same thing by the term as each other, or indeed that anyone understands what exactly it means.

    Partly as a consequence, I have several web pages on reflection:

    Dimensions for categorising types of reflection; and other notes

    N.B. "Reflection", besides light bouncing off surfaces, just means "thinking" in general English. But when used technically in education, or about "reflective practitioners" i.e. as an attribute of professional life, then there are different and contrasting senses even here.

    A longer, but older, set of notes on this is here: http://www.psy.gla.ac.uk/~steve/reflection.html

    Witticisms

    "Know thyself? If I knew myself I'd run away."
    Goethe

    "Only the shallow know themselves."
    Oscar Wilde
    (Cf. it seems that part of our definition of "creativity" is that it be surprising: even to the creator.)

    Being effective by being realistic about our weakness at reflection: the 12 steps

    One could look at the 12 steps programme as all about applying reflection remorselessly in order to correct one's behaviour. See the wikipedia article for a summary, refs, etc.

    What is interesting about seeing this as a paradigm of reflection is:

    The 12 steps (APA version):

    1. Admitting that one cannot control one's addiction or compulsion;
    2. Recognizing a greater power that can give strength;
    3. Examining past errors with the help of a sponsor (experienced member);
    4. Making amends for these errors;
    5. Learning to live a new life with a new code of behavior;
    6. Helping others that suffer from the same addictions or compulsions.

    The original 12 steps:

    1. We admitted we were powerless over alcohol and that our lives had become unmanageable.
    2. Came to believe that a Power greater than ourselves could restore us to sanity.
    3. Made a decision to turn our will and our lives over to the care of God as we understood Him.
    4. Made a searching and fearless moral inventory of ourselves.
    5. Admitted to God, to ourselves, and to another human being the exact nature of our wrongs.
    6. Were entirely ready to have God remove all these defects of character.
    7. Humbly asked Him to remove our shortcomings.
    8. Made a list of all persons we had harmed, and became willing to make amends to them all.
    9. Made direct amends to such people wherever possible, except when to do so would injure them or others.
    10. Continued to take personal inventory and when we were wrong promptly admitted it.
    11. Sought through prayer and meditation to improve our conscious contact with God as we understood Him, praying only for knowledge of His will for us and the power to carry that out.
    12. Having had a spiritual awakening as the result of these steps, we tried to carry this message to alcoholics, and to practice these principles in all our affairs.


    Last changed 5 Jul 2005 ............... Length about 900 words (6000 bytes).
    (Document started on 5 Jul 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/romer.html. You may copy it. How to refer to it.

    Romer's 12 principles for HE quality

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    This is copied from: http://www.qvctc.commnet.edu/people/qualed.html

    A review of research by The Education Commission of the States reveals the 12 attributes below as critical. These are drawn from Making Quality Count in Undergraduate Education , led by Gov. Roy Romer of Colorado, with Peter Ewell, Dennis Jones, and Charles Lenth. The report is available for $13 from ECS Distribution Center, 707 17th St, Suite 2700, Denver, CO 80202.

    An adaptation of the report is in the AAHE Bulletin, 4/96 [1996, April ?? vol.48 ]
    What Research Says about Improving Undergraduate Education Peter EwellĘ et. al. AAHE Bulletin, April 1996

    See also: Angelo, Thomas A. (1999, May) " Doing assessment as if learning matters most" AAHE Bulletin 51(9), 3-6.

    Quality is fostered by:

    A culture that values:

    1. High expectations
    2. Respect for diverse talents and learning styles
    3. Emphasis on the early undergraduate years

    A curriculum with:

    1. Coherence in learning
    2. Synthesizing experiences
    3. Ongoing practice of learned skills
    4. Integration of education and experience

    Instruction with:

    1. Active learning
    2. Assessment and prompt feedback
    3. Collaboration
    4. Adequate time on task
    5. Out-of-class contact with faculty


    Last changed 20 Jan 2008 ............... Length about 700 words (6,000 bytes).
    (Document started on 9 Apr 2007.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/rowntree.html. You may copy it. How to refer to it.

    Rowntree's 17 proposals for better assessment

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    (Here are other lists of assessment principles.)

    Rowntree,D. (1977) Assessing students: How shall we know them? (Kogan Page: London)

    In 1977, Derek Rowntree published a book that ended with 17 proposals for improving how assessment is typically done in Higher Education. In 2007 few have been adopted, and those that have, have been forced on academics directly or indirectly by legislation. The shameful conclusion seems to be that politicians know better than universities what is good educational practice.

    Here are my paraphrases of those proposals. The items that have been implemented are marked √.

    (Of the 17, numbers 10,14 have been essentially implemented; 9,12 are in progress, pushed from outside the universities, although we'll have to see whether they do become effectively implemented. To raise quality further, my own priorities would be: 1,5,7b,17.)

    1. Articulate the assessment criteria; including trying to express our implicit assessment-constructs. [N.B. this is urged by Sadler, and is an important focus in the REAP project.]

    2. Use more varied assessment methods. Make them educationally relevant.

    3. Give credit for what learners learned, as well as whether they learned what we intended. [N.B. this proposal is constructivist, conflicts with Biggs' "alignment" principle, and with the instructivist assumption that teachers know in advance everything that a learner should learn.]

    4. Assess "naturalistically" i.e. use assessment processes and products that are themselves educationally valuable. [Projects have always been like this. Even exam essays are related where the essay form is central to the discipline.]

    5. Give learners maximum feedback (not just a grade or rank, but summative of their traits/qualities).

    6. When criteria are judgmental, say (to learners) whether their performance is being compared to norms, criteria, our expectations, or the learner's own previous performance.

    7. Colleagues may have quite different perceptions.
      • Accept this, don't converge unnaturally; report divergence.
      • Give back exam scripts.

    8. Resist drifting to criteria that attract consensus marks: stay with the educationally relevant ones.

    9. (√) Support portfolios: including both products and assessments from many including peers and self. [The growing requirement to support "personal development portfolios" is beginning to address this.]

    10. √ Report results only to learners (i.e. not made public). [Data protection act.]

      • Focus on eventual, not average or early, state (unless describing improvement rate). [I.e. simply averaging over continuous assessment undermines the value of assessment as a measure of a learner when they graduate (let alone afterwards).]
      • Emphasise learners' strengths, but mention weaknesses.

    11. (√?) Don't conflate i.e. no portmanteau grades. Prepare a multi-dimensional profile: with considerable narrative content. [There is currently a move to transcripts, not simply a single overall degree category.]

    12. No pass/fail except for professional competence certification. (The reader of the report should make the judgement of how good is good enough.)

    13. √ No comments in confidential references that you wouldn't have learners read. [Freedom of information act, at least in Scotland.]

    14. Be explicit in references that the assessment is about specific things; that it is not about permanent qualities; require that you are given some understanding of how the reader will use the report; get the relevant qualities from the reference-requester.

    15. If we predict learners' future qualities, follow up and see how right we were(n't).

    16. Give health warnings on certificates (transcripts) i.e. about the limits on how much weight to give accreditations as a measure of the person. E.g. "Relying too heavily on other people's opinions can damage your sense of reality."


    Last changed 15 March 2005 ............... Length about 900 words (3,000 bytes).
    (Document started on 22 Feb 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/s.html. You may copy it. How to refer to it.

    S-shaped curve for uptake of innovations

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    It is often said that innovations or new practices are taken up in an S-shaped or sigmoid curve. That is, there are broadly three phases. First just a few take it up: early adopters, the first few percent, over a long slow initial period of low usage; the first low slope of slow increase, and low total use. The third phase is also a low slope and slow increase, but high total use: these are the last reluctant ones. The second, middle phase has a high slope of rapid increase.

    This view is attributed to Everett M. Rogers, and is described in his textbook "Diffusion of Innovations" (1962; 4th edition dated 1995; The Free Press; New York) e.g. ch.1 p.11 fig.1-1.

    In fact you will get a sigmoid curve for cumulative adoption if the underlying rate of new adopters (new adoption events) forms a normal distribution (and if there is no significant rate of people dropping the innovation).

    graph

    Rogers also talks of pro-innovation bias: from the tendency to study only those innovations that in fact did spread and become ubiquitous. Clearly such cases are no guide to what determines uptake in general.


    18 Aug 2011 ............... Length about 500 words (5,000 bytes).
    (Document started on 20 Oct 2005.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/senses.html. You may copy it. How to refer to it.

    How many senses do humans have?

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    [There's a New Scientist article, 29 Jan 2005 by Bruce Durie, on how many senses we have.]

    The only wrong answer is Aristotle's answer of 5: vision, hearing, touch, taste, smell.

    Defensible answers are:

    Of course the real answer is that this is the wrong way to look at it. Sensing doesn't cause perception: real perception is all about integrating information across senses, across time, across space if you are (as is normal) moving around partly in order to perceive better.

    External chemical sensing; Senses of smell; Olfaction

    Of the chemical senses of external stimuli, it (currently) appears there may be 4 different sets of sensors:
    1. Taste.
      1. The taste buds on the tongue detect 5 different flavours.
      2. Most perceived taste comes from Olfaction on exhaled air from the oral cavity.
    2. Olfaction by the Olfactory bulb and nerve, analysing airborne molecules inhaled by the nose.
    3. Trigeminal: airborne molecules are often also detected by other sensors in the whole nose and oral cavity, transmitted by the trigeminal nerve, perceived as hot/cold, but combined as part of an odour percept.
    4. Vomeronasal: there is some but insufficient evidence, both behavioural, anatomical, and from brain scans, that humans have a further set of detectors which in animals respond to pheromones, whose sensing we are unconscious of but which do affect us. (We are largely unconscious of some other things, such as a shortage of oxygen in the air, which undoubtedly have huge effects on us.)

    The theory of how olfaction works is still undecided, but it seems clear enough that it is like colour perception in that: a) There are a number of different receptor types b) the same stimulus (odour molecule) reacts with several receptor types at once; so that c) it is the ratio (relative strength) of responses that tells a person which odour it, rather than having one receptor type per detectable smell.

    Dogs (bloodhounds) vs. humans: sensitivity to odours 10 million to one.
    Human sensitivity to a strong odour can be 9 parts per trillion.
    A silkworm moth can detect a single molecule of pheromone.
    There are some cases of significant differences in what humans smell: like "colour blindness".

    Leffingwell,J.C. (2005) "Olfaction: Update no.5" Leffingwell Reports vol.2 no.1

  • G protein molecular nanomachine
  • Caraway vs. spearmint
  • Limonene: one example of chirality


    Last changed 6 Nov 2011 ............... Length about 200 words (2,000 bytes).
    (Document started on 22 July 2011.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/stages.html. You may copy it. How to refer to it.

    5/12 stages/steps

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    5 stages of grieving

    1. Denial
    2. Anger
    3. Bargaining
    4. Despair
    5. Acceptance

    12 steps

    The 12 steps (APA version):
    1. Admitting that one cannot control one's addiction or compulsion;
    2. Recognizing a greater power that can give strength;
    3. Examining past errors with the help of a sponsor (experienced member);
    4. Making amends for these errors;
    5. Learning to live a new life with a new code of behavior;
    6. Helping others that suffer from the same addictions or compulsions.

    See here for more / the original 12 steps.


    Last changed 3 April 2011 ............... Length about 900 words (6000 bytes).
    (Document started on 3 April 2011.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/statsjokes.html. You may copy it. How to refer to it.

    Stats jokes

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    "The plural of anecdotes is not data" Lee Shulman.

    "Homeopathic samples" Karon Mcbride.

    What is true, is that at the dilutions used in homeopathy, Avogadro's number tells us there is unlikely to be even a single molecule left. However we have to be careful joking about this. Apparently chemists take seriously that solid particles of a certain crystal type, once created in a lab, can appear in labs on other continents and force the same chemical to take that crystal form, even when not wanted. Avogadro's number tells you this is quite possible. Every breath you take probably contains one molecule that was exhaled by Julius Cesar: not in his lifetime but in the very last breath he took as he died.


    Last changed 26 Oct 2007 ............... Length about 200 words (2,000 bytes).
    (Document started on 21 Dec 2004.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/tandlpics.html. You may copy it. How to refer to it.

    Teaching and Learning: their nature in pictures

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    student feedback
    Generating feedback to students


    student feedback
    What course feedback from students tells you



    Last changed 15 June 2010 ............... Length about 600 words (6,000 bytes).
    (Document started on 13 Oct 2007.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/teach.html. You may copy it. How to refer to it.

    The three different parts of (HE) teaching

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Diagram
    Click to show the picture bigger.

    It is conventional to divide the main functions of an academic into three: teaching, research, and administration; and to note that ability at one is unrelated to ability at the others. (I.e. an individual may be good or bad at them in any combination.)

    "Teaching" itself also consists of three or four quite different tasks, and again, being good at one bears no relation to ability at the others:

    1. Curriculum design: deciding the content and outcomes. Selecting the topics that will be taught, and probably selecting or writing the texts and other materials. Product design.
    2. Course design: Designing the learning activities. Process design.
    3. Delivery:
      1. Setup: preparation, planning. Preparing for delivery of one instance of the designed activity e.g. room booking, slide creation, handout photocopying, Just in time teaching (have to read student quiz results or requests for explanation before the lecture in order to decide what to address); ...
      2. Presentation. Implementing the specified design. N.B. this is delivering the performance of the teacher's actions: it cannot deliver learning, which is a learner action. The same mostly applies to setup too. (Also known as: presentation, delivery, implementation, instantiate, run, execute, perform, realise, enable, perform.)

    Note that the first requires a subject expert whether or not they are a good teacher, the second might be informed by memories of what you found useful in learning this yourself, the last may be best done by an actor. Yet most attempts to measure the effectiveness of a teacher measures only the last; and much HE staff training focuses on that. To measure the first cannot be done by comparing exam results which only makes sense for identical curricula. Measuring the second requires alternative course designs to be compared, and when done, these are not usually attributed to the people who did the design.

    In the REAP project, and in other literature, dramatic improvements in learning outcomes can depend on course design i.e. redesigning the learning activities. The literature on presentation often reports that while students have reliable opinions distinguishing what they prefer, it often doesn't change learning outcomes for students working for credit (as opposed to audiences only listening for interest).

    N.B. these 3 roles are independently applied at many levels or time scales:

    Didactique

    "Didactique": in general, this refers to expertise in teaching one subject and the issues that are not general across all subjects. In other words, a reminder that teaching, like research, is discipline specific.

    If this is applied to curriculum design, then it implies appreciating the main difficulties in learning this particular topic and regrouping and or sequencing the topics to improve this. Common issues are threshold concepts; common prior (mis)conceptions; whether to begin with applications (because they are authentic and can connect learners to motivation) or basics; dealing with two topics together because they always arise together in everyday experience e.g. a physicist might teach Newton's laws in one course and friction in another, but the main barrier to believing in Newton's laws is that almost all our experience is of contexts with friction where motion does NOT persist in the absence of forces.

    An extended diagram

    Diagram
    Click to show the picture bigger.


    Last changed 27 Jan 2012 ............... Length about 700 words (7,000 bytes).
    (Document started on 20 Jan 2008.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/tri.html. You may copy it. How to refer to it.

    Fast, cheap, and good: The cost-quality tradeoff triangle / quadrilateral

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Most of the education literature, especially that related to pedagogy and/or technology, maintains a prudish silence about money. This renders it largely irrelevant to practitioners and policy makers. For instance many people believe (even if wrongly) that the ideal learning situation is to have unlimited 1:1 time with a personal tutor. That is pedagogy solved then.

    In fact education is like almost all design or construction: it is subject to a triangle of factors. You can optimise for two at the expense of the third, but you can't maximise all three at once.

    The traditional triad of factors are:
    • Cost
    • Quality
    • Time
    • Cheap
    • Good
    • Fast
    triangle triangle
    or in project management:
    • Cost
    • Scope
    • Time
    triangle
    But if you follow Phillips (1996) and Reeves (1992) then for education, time is fixed (you can only use what is ready in time for the course), and the triangle is:

    Not a triad but a quad

    So really in general there are 4 factors.
    • Cost
    • Quality
    • Quantity / scope
    • Time
    triangle Original think piece

    Sometimes you would prefer to maximise or minimise a factor (e.g. the cheaper the better); but sometimes, it is that you have to stick to a pre-determined value e.g. it must be ready by a deadline (but little reward for being early); must not exceed the budget (but you'll only lose any money left over).

    Sometimes you can convert money to time by hiring more people or buying in parts; but more often there isn't the time for that (recruitment and training take time), which is why cost and time are separately listed.

    Sometimes you might consider varying all 4; but often a job in effect specifies some factors, leaving only some to be varied. You can say then that the fixed ones are top priority, the variable ones less so.

    Eg1 Time and errors in a simple task. Errors -> quality. E.g. washing the dishes: quantity is fixed (you must do them all); cost is fixed (no money, you have to do them); the tradeoff is between doing them fast or doing them carefully.

    Eg2 Quality first. Sydney opera house; writing Fawlty Towers. Things you've done often have fairly well known standard time and costs; outstandingly creative things have unknown time and costs. The opera house ran over budget by about 10 times in both time and money, but the quality left the city with a landmark that is recognised round the world from a glimpse. Cleese once said it took them about 3 times longer to write the Fawlty Towers scripts than the standard BBC allowance (in time and money); but these are the shows that are still celebrated decades later, while others done on time and to budget were never re-run. These are cases of putting quality first.

    When a project (e.g. a road bridge) involves safety, it often means safety-quality has to be put first (or the project cancelled without completion).

    Eg3 On time and to budget. What this means, but doesn't say, is that quality is put last.

    Perhaps unexpected corollaries of this in HE are:

  • An HEI requires written feedback to students to be returned within a fixed time. There is no extra money, nor time for the staff doing it, so quality goes down (fewer comments).
  • A course tries giving comments not in writing, but by recorded audio: it is easier for staff to say what they mean than to write it; and the quality and quantity of personal feedback went up (Merry & Orsmond, 2007).

    Postcript: Vitruvius' triangle

    The Roman engineer and architect Vitruvius spoke of a triangle, or triad, of qualities that a building work should have. No mention of tradeoffs, but of requiring all three.

    These are 3 sub-aspects of quality.

    References

    Phillips,R. (ed.) (1996) Developer's guide to interactive multimedia: A methodology for educational applications (Computing centre, Curtin university of technology, Perth, Western Australia)

    Reeves,T.C. (1992) "Evaluating interactive multimedia" Educational technology May, pp.47-52.


    Last changed 24 Aug 2008 ............... Length about 900 words (7,000 bytes).
    (Document started on 23 Aug 2008.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/behav.html. You may copy it. How to refer to it.

    The three parts of learning a new practice

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Often in learning, you are really only learning how to talk about and reason with a new idea. However when you are learning a new approach to existing habits (e.g. a management course for managers; a slimming course for eaters; a safety course for lab technicians who have already years of experience), then there are 3 parts to the learning: getting the ideas, going over your familiar environment learning how to recognise how the ideas apply to it, going over your familiar behaviour and deciding how and when it must now be different.

    Standard impoverished HE teaching really only addresses the learning and teaching of new concepts at the public, general, abstract level. The learner, if good, will be able to recall and use the main terms, and explain what they mean in both formal and paraphrased ways; and perhaps apply them to examples of the kind dealt with in the textbooks. In some cases, this then has no impact: someone may go to such a course, but their managers may be dismayed that it has no effect on how they do their job.

    The triad

    A triad of phases of learning is what is required (spending approximately equal time on each) for learning to make a direct difference to the learner's life:
    1. Introduce (and exercise) conceptual learning, as in ordinary teaching.
    2. Have each learner then go over concrete situations they have already experienced, and learn to recognise how the taught concepts do or do not apply in each situation.
    3. Have each learner go over their normal routines and decide where, when, how to insert different behaviour into them. Where interactions with other workers are important, then how to change one's own actions in this context will also have to be addressed at length for any practical effects of the course to materialise. Food safety training in supermarkets is difficult to implement where a store is undermanned (so no time to do cleaning) and managers are under pressure to reduce food wastage (throwing away cooked food that is too old). Introducing a new accounting practice is unlikely to be something a single person can do, since accounts are the interface between many different people and unilateral changes will break communications.

    Examples

    1. Slimming. First teach concepts such as (kilo)calories. Then to recognise snacks as food as much as meals; then that all drinks except water contain calories. Then to go over one's daily eating routines and decide what to change.
    2. Bioethics. First concepts such as utilitarianism. Then go over a set of classic experimental work in biology, reviewing it for ethical issues; and ditto for applied work (in farming, in pharmaceuticals, ...). Then for actions the learner might be involved in, and when they would act e.g. in doing an experiment because the university asked them to, because a funder asked them to, jobs, ...
    3. A health and saftey course for chemistry research students. First the (legal) concepts. Then perhaps photographs of various scenes in labs, with the task of spotting what aspects of these typically very cluttered pictures violate which safety principle, if any. Then reviewing each student's actual or planned procedure for their own experiments with a view to modifying them as necessary.

    Applicability

    This triad may be least applicable to learning undergraduate subjects where the student has no existing practical experience e.g. elementary particle physics, classical literature. It will have the most applicability where the subject is practical AND the learner has already developed habits. E.g. health and safety in the lab for chemistry students, bioethics for biology students, new accountancy practices for experienced administrators, hygene (food safety) for experienced family cooks now moving into a catering job, continuing professional development (CPD) courses for teachers with years of experience, slimming or addiction personal retraining, cognitive behavioural therapy.

    The point is for any activity where we are already reasonably experienced and practised, we do not think out what we do from first principles, but rely on "habits" and practised ways of acting. Merely learning new concepts does not itself touch our behaviour nor perception. If we want the new concepts to touch our behaviour or perception, then we need to specifically exercise these in connection to the new ideas.

    An alternative triad

    The above triad is what someone designing a training course needs: three aspects, all of which need substantial time and effort from both teacher and learners. More theoretically, we might say (as Laurillard does) that all (good) teaching and learning has both abstract, general aspects and personal, practical ones; but that there are in fact three different major kinds of the latter:



    Last changed 8 April 2012 ............... Length about 1,000 words (10,000 bytes).
    (Document started on 2 April 2012.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/triad3.html. You may copy it. How to refer to it.

    Reading, discussing, writing

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    "Reading maketh a full man, conference a ready man, and writing an exact man."

    This aphorism suggests that studying, in fact I would say Higher Education (HE), rests on 3 activities; reading, discussing, and writing. Since Bacon is often cited as the first to publish an explicit scientific method, we should consider whether this formula is a general educational one and not limited to essay-based Arts subjects. It comes from an essay by Francis Bacon in 1625, and in 1753 Samuel Johnson wrote another essay elaborating on it (local copies). Together they make the case for the importance of each, and how omitting any one leads to weaknesses: all three are required for rounded learning. We might say that they correspond to receiving ideas, interacting about / with ideas, and generating one's own detailed idea.

    This is about book learning (of declarative / conceptual ideas), in contrast to the learning of practical skills (as in triad 1 and triad 2). Currently it may constitute a relevant and insightful critique of HE where there is far too little discussion by students of ideas. The measure of this is the number of minutes per day a given student is actually speaking about some intellectual idea. (Listening to discussion may have some other value, but does not count at all under this heading, as Johnson's essay makes clear if you look at it with this question in mind.)

    If we take this as a serious educational rule, then for each course we need to consider an even division in times spent on each of reading, discussing, and writing; and also an equal weight of assessment for each.

    We might say that reading, discussing, writing correspond also to receiving, negotiating, generating ideas; and to interaction with an expert, peers, and oneself (reflection).

    (A rather different explanation, more psychological than educational, would explain discussing vs. writing in terms of extraversion/intraversion. Susan Cain on the power of introverts (20 mins). "There's zero correlation between being the best talker and having the best ideas." Correct: but the point from Johnson is that everyone is better for having both skills, not either/or; and regardless of the personal disposition measured by the personality dimension.)

    Thinking

    Confucius discusses the role of "thinking": shouldn't thinking (which we could call "reflection" if it makes us feel better) be part of education?

    "I used to sit alone thinking about this and that. Sometimes I even forgot my meals or bedtime. Still I gained very little. Later I shifted to reading omnivorously, but I did not benefit a great deal either. At long last I came to see that reading in a mechanical way without using my brains was no use. On the other hand, if thinking is divorced from the reality and no due attention is paid to reading, one will continue to feel puzzled by many things. One should constantly review what he has learned and combine reading with thinking. In thus making use of the theories one has learned to guide his thought and help analyze the problems at hand, progress will be achieved."

    I suggest that writing, from the standpoint of learning, plays the part of thinking: the effort of writing forces careful thinking. Johnson says nothing about anyone else having to read what you write: the point is the precision and order that writing demands of you. In that case, Confucius (two thousand years earlier) was also pointing out the complementary requirements for reading and writing in successful learning.

    Finale

    Confucius talks (at least in one translation of the Analects) of thinking, reading, and teaching. ("Keeping silent and thinking; studying without satiety, teaching others without weariness: these things come natural to me." [Analect 7.2])

    If we can equate thinking and writing with respect to their benefit to learning, then this is writing, reading, and teaching; or doing it oneself (by thinking or writing), seeing it (by reading another's expression of it), and teaching (i.e. discussing it with another person). This suggests a close analogue between Bacon's aphorism for conceptual learning, and the practice-oriented surgeon's aphorism for skill learning: "see one, do one, teach one".

    Summary notes, as a table

    Read Discuss Write
    Bacon Reading Conference Writing
    Confucius Reading Teaching Thinking
    Surgical analogue See one Teach one Do one
    The inner activity Knowing (understanding) Developing answers to critical challenges Self-correction of facile success in argument
    Virtue (if done the right amount) A full man A ready man An exact man
    If done too little, then to compensate you need: Cunning to conceal your ignorance Quick wittedness A big memory
    If done too much Sloth Affectation "The humour of the scholar"
    Benefit(2) Delight Ornament Ability
    Benefit(2.2) Amuse yourself "Talk well" for others Taking decisions, disposition of business.
    Benefit(3) ? Grace Method

    References

  • Francis Bacon (1625) "Of studies" in Essays (essay 50 of 58).
  • Samuel Johnson's (1753) follow-up "On studies" (first appeared, untitled, in number 85 of The Adventurer, August 28, 1753).
    They can both be found in books of their essays.   Local copies in one PDF document
      See here and here for web copies of Bacon's 1625 essay; and here for Johnson's.

    Confucius: the second quote was from Analect 7, on learning. The analects are Confucius, as written down by his followers.

  • A.C.Muller's (1990, 2011) translation
  • A different translation


    Last changed 6 Nov 2007 ............... Length about 900 words (6,000 bytes).
    (Document started on 5 Nov 2007.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/vle.html. You may copy it. How to refer to it.

    VLEs: best and worst features

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Worst

  • Having all material protected. Even with guest logins unrestricted, this still means Google can't find it, and others feel unwelcome and may not enter. However this means a student can't find it using normal internet access and Google: instead they must go to a meeting and write down without error the URL. So immediately VLEs are in practice only accessible to those who attend F2F meetings and lose the normal benefits and convenience of the internet. Colleagues can't view the material without special effort, prospective students can't see it, etc. In reality, only a tiny part of a course really needs protection (e.g. individuals' marks): the design is the inverse of what is appropriate.


  • Hiding course info from prospective students, from those with glitches in their signups, from colleagues
  • Above all, from Google so even legit students can't easily find it.
  • Basically, all courses have public and private aspects, so cannot have all the course info in one place, and VLEs thus fail in their primary idea of a single tool for putting on a course.
  • Restructuring them so that default is visible to the world, and page by page access control. Only hide a few things e.g. grades; and write access to forums.
  • For students, should support them having one place to login for several courses; and a single feed combining notices/msgs from all these.
  • Hides bboards; prevents the serendipity of Ruskin getting Grayling joining in.
    [dougiamas reply: but you could invite grayling. A truly T-centric reply]
  • One stop place for students for all course docs.

    Best

    In a talk, Martin Dougiamas listed the following approximate sequence in which teachers (academics) typically started to use different types of activity (feature) in Moodle (and no doubt this applies to other VLEs too). The conventional negative spin on this is "Isn't it awful, you introduce a VLE and staff just use it to dump their slides on it". (This ignores the fact that most students welcome this if, as often, they weren't getting access to the slides before.) However a positive spin could be: "In the medium term, most HE staff are going to move through this developmental progression, and end up at the top end: far beyond where most were before in their teaching. So VLEs are a slow but powerful scaffolding that is improving teaching practices in HE."

    1. Put up the handouts
    2. Add a passive Forum
    3. Add Quizzes, Assignments (reduce management)
    4. Use Lesson, Wiki, Glossary, Database maybe
    5. Use the Forum seriously and actively
    6. Combine the activities into sequences
    7. Think more deeply about learning activities / design
    8. Use the Survey module, Workshop maybe
    9. Sharing ideas, active research, reflection

    What most of us most immediately recognise here, is that the first thing staff do is dump their slides on line: requires no real work. Next, we see forums created but no student activity on them. But next again (maybe a year or two later) staff discover how to stimulate student discussion.

    Further on in the sequence, I can see echos of issues I've seen elsewhere: for instance going beyond isolated learning activities and thinking about piecing them together so that one leads to another (e.g. write your first draft of an assignment, students read each others', give each other comments, revise their own).

    And at the advanced end (the bottom), I see forms of "contingent teaching" where what the teacher picks up from the class changes what they do. Here (in Moodle) it is about using the Survey to get feedback on student views and ways of learning, just as Just In Time Teaching uses student answers to a quiz to determine what the next class will address.


    Last changed 11 Sep 2006 ............... Length about 500 words (4,000 bytes).
    (Document started on 10 Sep 2006.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/web2.html. You may copy it. How to refer to it.

    Web 2.0

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    "Web 2.0" is the buzzword in EdTech for 2006.
    For a briefing, try wikipedia. For one version of meaning and history, try O'Reilly's long and interesting article

    Here, a brief note for myself. Web 2.0 is a new buzzword, and is not of course used consistently. It has about 4 areas of overlapping meaning.

    The different senses

    Great quotes, phrases.


    Last changed 24 Jan 2007 ............... Length about 300 words (4,000 bytes).
    (Document started on 27 Dec 2006.) This is a WWW document maintained by Steve Draper, installed at http://www.psy.gla.ac.uk/~steve/best/wikip.html. You may copy it. How to refer to it.

    Wikipedia

    By Steve Draper,   Department of Psychology,   University of Glasgow.

    Just to hold some pointers to articles on wikipedia. wikiP itself

  • My nomination for the best written wikiP entry: usage of which and that

  • Why wikipedia must jettison its anti-elitism Larry Sanger 31 Dec 2004 Kuro5hin
  • NPOV (neutral point of view) rule for wikiP and talk page and tutorial

  • Jaron Lanier "Digial maoism: the hazards of the new online collectivism"
  • and some responses   more responses   more responses

    PsyDict project

  • wiktionary
  • Open source / copyright     GNU licence: about     text of license
  • free software
  • Stanford (web) philosophy encyclopaedia: itself (UK mirror) itself     wiki entry on it
  • scholarpedia
  • wikiP education project
  • Wikiversity   Wikiversity