Cafe Cerebral - Discriminant Analysis

Discriminant Analysis works by combining variables in such a way that the differences between predefined groups are maximized. The group membership must be known before using Discriminant Analysis.

Consider a simple two-group example. The aim is to combine (weight) the variable scores in some way so that a single new composite variable, the discriminant score, is produced. One way of thinking about this is in terms of a recipe, changing the proportions (weights) of the ingredients will change the characteristics of the finished food. At the end of the process it is hoped that each group will have a normal distribution of 'discriminant scores'; the degree of overlap between the discriminant score distributions can then be used as a measure of the success of the technique.
For example:

The discriminant scores are calculated from a Discriminant Function which has the form:
D = w1Z1 + w2Z2 + w3Z3 +.... wiZi

Where
D = discriminant score;
w i = weighting (coefficient) for variable i;
Z i = standardized score for variable i (a standardized variable has a mean of 0 and a standard deviation of 1).

Fig 1
 
Fig 2

Clearly the two groups can be separated by these two variables, but there is a large amount of overlap on each single axis (although the y variable is the 'better' discriminator). It is possible to construct a new axis which passes through the two group centroids ('means'), such that the groups do not overlap on the new axis.

The new axis represents a new variable which is a linear combination of x and y, i.e. it is a discriminant score. There are four main steps to discriminant analysis
Discriminate analysis has potential applications in predicting events like the success or failure of new product, deciding whether a student should be admitted to graduate school, determining the category of credit risk for a person, or predicting whether a firm will be successful etc. Discriminant analysis is capable of handling two or multiple groups or classifications like male vs. female or high vs. low etc.
Contact Mu Sigma
info@mu-sigma.com
Site Map | Disclaimer | Privacy Policy
© 2005 - 2009 Mu Sigma. All rights reserved