Last changed 28 Sep 2002 ............... Length about 900 words (6000 bytes).
This is a WWW document maintained by Steve Draper, installed at

Web site logical path: [] [~steve] [grumps] [this page]

List of miniprojects for Grumps

This is my view of the list of REDDIs (rapidly evolving data driven investigation) miniprojects / client projects, as of the date at the top of this page, which are now in prospect for Grumps. They are roughly in order of definiteness i.e. remoter hopes towards the end.

Range of investigation types

We may be able to illustrate a range of types of investigation.

One type of variation is in the sense of "data mining": whether an investigation defines a set of data and goes "fishing" by induction: seeking patterns that just emerge, versus coming with a specific hypothesis about what pattern to look for and testing for that. Induction is likely to require more statistical expertise.

Another type of variation is in the number of kinds of data combined. We may be able to illustrate this, and furthermore its importance in some cases for getting meaning out of the data. Grumps itself just gives software usage or user input data. We may also use: PRS handset data, stills from CCTV, human observation to produce hypotheses which are then tested (as Kate Gilmore did), deliberate artificial testing of users to produce reference or calibration data, other databases on the same users (e.g. class exam records).

Another type of variation is in the bottlenecks. One bottleneck can be statistics: finding the right way to express a question in terms of (statistical) functions of the data.

Another bottleneck can be artificial testing or calibration. Whether designing the extraction tool, or designing a data filter, or finding what indicators in the data correspond to a particular meaning (such as the user switching tasks), a key method is likely to be active experimentation where someone imitates a user to generate data of known meaning, while the resulting data is watched (preferably in real time) to establish correspondences, test data cleaning validity, etc.

Web site logical path: [] [~steve] [grumps] [this page]
[Top of this page]