Produces statistics and graphs for checking sensory panel performance (D.I. Hedderley).
Options
PRINT = string tokens |
Controls printed output (aovtables, graphs, summarystatistics, tables); default grap, tabl |
|---|---|
TREATMENTS = factor |
Factor defining the different treatments that are being assessed |
SESSIONS = factor |
Factor defining the sessions on which the assessments were done |
ASSESSORS = factor |
Factor defining the individual assessors |
SCALING = string token |
Equal scaling for x and y axes on Drift-Unreliability and Discrimination-Disagreement graphs (equal, none); default none |
DESCRIPTION = text |
Extra information to print on graphs |
Parameter
DATA = variates |
Variate for each attribute, containing the recorded score |
|---|
Description
A trained panel of sensory assessors may test a set of products (e.g. taste a set of food samples) at several sessions, each time rating them on a range of attributes. If you have several measurements of the same samples from the same individuals, you can investigate how consistent and discriminating the individual assessors are. The scores recorded for the attributes are specified, in a list of variates, by the DATA parameter. The TREATMENTS, SESSIONS and ASSESSORS options supply factors defining the treatment, session and assessor involved with each unit of the DATA variates.
SAGRAPES presents six statistics based on analyses of variance, proposed by Schlich (1994), to describe how well individual assessors use individual attributes. These are:
| Location | the assessors’ overall mean score on that attribute; |
|---|---|
| Span | the mean standard deviation of the assessors’ scores within a session; |
| Unreliability | the ratio of the root mean square residual (from a model fitting TREATMENTS and SESSIONS main effects to each assessor) to Span, i.e. what proportion of the spread in an assessor’s ratings is due to changes in the relative scoring of samples in different sessions; |
| Drift-mood | the ratio of the root mean square for sessions (from a model fitting TREATMENTS and SESSIONS main effects to each assessor) to span, i.e. how much an assessor’s average score changes from session to session, compared to the spread of scores within a session; |
| Discrimination | the variance ratio for TREATMENTS from a model fitting TREATMENTS and SESSIONS main effects to each assessor; |
| Disagreement | an estimate of how much each assessor contributes to the variance ratio of the ASSESSOR.TREATMENTS interaction (from a model fitting ASSESSORS/SESSIONS + TREATMENTS/ASSESSORS to the whole panel). |
The PRINT option controls the output, with the following settings.
tables |
prints a table of these statistics for each assessor for each of the attributes in DATA. |
|---|---|
graphs |
produces a composite plot of three graphs (Location against Span, Unreliability against Drift-mood, and Discrimination against Disagreement) for each attribute. The points on the plots are labelled with the labels from the ASSESSORS factor. On the plot of Discrimination against Disagreement, a star is plotted at the 5% critical values of the relevant F distributions; so ASSESSORS to the right of the star are significantly discriminating between TREATMENTS, and ASSESSORS above the star contribute significantly to the ASSESSORS.TREATMENTS interaction. |
aovtables |
prints the panel ANOVA tables for each attribute. |
summarystatistics |
prints overall summary statistics (numbers of observations, means and standard deviations) for each attribute, across the whole panel and all samples. |
Unreliability and Drift-mood are measured on the same scale (multiples of Span), as are Discrimination and Disagreement (F-ratios). Setting option SCALING=equal scales the x and y axes of the Unreliability against Drift-mood and Discrimination against Disagreement graphs equally.
The DESCRIPTION option can be used to provide additional information (for instance, the name of the study) to label the graphs.
Options: PRINT, TREATMENTS, SESSIONS, ASSESSORS, SCALING, DESCRIPTION.
Parameter: DATA.
Method
Schlich (1994) proposed the procedure, and implemented it in SAS. This procedure uses the calculations given in the article to produce graphs for individual attributes. Currently it does not produce the graphs comparing different attributes which Schlich suggests.
Action with RESTRICT
Any of the DATA variates, or the TREATMENTS, SESSIONS or ASSESSORS factors, can be restricted to analyse a subset of the data units.
Reference
Schlich, P. (1994). GRAPES: A method and a SAS program for graphical representations of assessor performances. Journal of Sensory Studies, 9, 157-169.
See also
Procedure: GENPROCRUSTES.
Commands for: Multivariate and cluster analysis.
Example
CAPTION 'SAGRAPES example',\
!t('Data provided by Per Brockhoff,',\
'Royal Veterinary and Agricultural University, Denmark;',\
'copy available at http://www.dina.dk/~per/SISsensory/potato.sas',\
'Study involved 8 assessors (Asses) scoring 4 mashed potato',\
'products (Product) 3 times (Replic). Assessor 2 missed session 3.');\
STYLE=meta,minor
VARIATE Watery,Floury,Sweet
FACTOR Asses,Product,Replic
READ Asses,Product,Replic,Watery,Floury,Sweet
1 1 1 41 119 57
1 1 2 100 47 90
1 1 3 60 44 38
2 1 1 105 123 71
2 1 2 31 118 86
2 1 3 * * *
3 1 1 42 150 19
3 1 2 62 111 41
3 1 3 30 68 54
4 1 1 31 124 75
4 1 2 28 113 85
4 1 3 12 19 77
5 1 1 43 60 63
5 1 2 52 102 42
5 1 3 32 131 51
6 1 1 35 85 88
6 1 2 39 99 20
6 1 3 23 57 0
7 1 1 82 117 49
7 1 2 70 86 78
7 1 3 63 62 72
8 1 1 53 110 0
8 1 2 11 10 62
8 1 3 11 130 27
1 2 1 4 4 90
1 2 2 43 4 101
1 2 3 105 77 79
2 2 1 93 27 79
2 2 2 107 77 102
2 2 3 * * *
3 2 1 10 95 81
3 2 2 26 45 76
3 2 3 58 9 87
4 2 1 9 23 93
4 2 2 51 78 93
4 2 3 149 103 87
5 2 1 6 28 98
5 2 2 40 44 73
5 2 3 45 49 91
6 2 1 16 42 63
6 2 2 43 5 71
6 2 3 62 39 74
7 2 1 17 8 43
7 2 2 35 54 108
7 2 3 28 23 104
8 2 1 44 43 115
8 2 2 94 24 129
8 2 3 115 10 133
1 3 1 65 26 33
1 3 2 131 119 30
1 3 3 125 127 51
2 3 1 23 49 46
2 3 2 110 109 76
2 3 3 * * *
3 3 1 10 138 19
3 3 2 14 137 10
3 3 3 45 86 27
4 3 1 41 88 85
4 3 2 33 93 93
4 3 3 58 29 77
5 3 1 55 75 77
5 3 2 27 61 65
5 3 3 102 124 72
6 3 1 21 56 17
6 3 2 17 * 7
6 3 3 43 112 0
7 3 1 10 123 22
7 3 2 70 65 67
7 3 3 90 47 35
8 3 1 0 150 13
8 3 2 114 134 103
8 3 3 48 97 27
1 4 1 53 127 96
1 4 2 30 26 114
1 4 3 10 84 111
2 4 1 63 109 89
2 4 2 45 87 111
2 4 3 * * *
3 4 1 21 95 61
3 4 2 44 35 64
3 4 3 14 37 68
4 4 1 78 131 118
4 4 2 17 60 102
4 4 3 17 56 87
5 4 1 14 108 109
5 4 2 19 86 78
5 4 3 40 76 88
6 4 1 10 29 107
6 4 2 27 83 86
6 4 3 53 30 90
7 4 1 10 70 57
7 4 2 25 103 67
7 4 3 28 73 51
8 4 1 12 78 143
8 4 2 26 102 129
8 4 3 48 67 101 :
SAGRAPES [PRINT=aovtables,graphs,summarystatistics,tables;\
TREATMENTS=Product; SESSIONS=Replic; ASSESSORS=Asses]\
Floury,Watery,Sweet