IMSL C# Numerical Library

ClusterHierarchical Class

Performs a hierarchical cluster analysis from a distance matrix.

For a list of all members of this type, see ClusterHierarchical Members.

System.Object
   Imsl.Stat.ClusterHierarchical

public class ClusterHierarchical

Thread Safety

Public static (Shared in Visual Basic) members of this type are safe for multithreaded operations. Instance members are not guaranteed to be thread-safe.

Remarks

Class ClusterHierarchical conducts a hierarchical cluster analysis based upon a distance matrix, or by appropriate use of the argument transform, based upon a similarity matrix. Only the upper triangular part of the dist matrix is required as input.

Hierarchical clustering in ClusterHierarchical proceeds as follows:

  1. Initially, each data point is considered to be a cluster, numbered 1 to n = npt, where npt is the number of rows in dist.
  2. If the data matrix contains similarities, they are converted to distances by the method specified by the argument transform. Set k = 1.
  3. A search is made of the distance matrix to find the two closest clusters. These clusters are merged to form a new cluster, numbered n + k. The cluster numbers of the two clusters joined at this stage are saved as Right Sons and Left Sons, and the distance measure between the two clusters is stored as Cluster Level .
  4. Based upon the method of clustering, updating of the distance measure in the row and column of dist corresponding to the new cluster is performed.
  5. Set k = k + 1. If k is less than n, go to Step 2.

The five methods differ primarily in how the distance matrix is updated after two clusters have been joined. The argument method specifies how the distance of the cluster just merged with each of the remaining clusters will be updated. Class ClusterHierarchical allows five methods for computing the distances. To understand these measures, suppose in the following discussion that clusters A and B have just been joined to form cluster Z, and interest is in computing the distance of Z with another cluster called C.

methodDescription
0Single linkage (minimum distance). The distance from Z to C is the minimum of the distances ( A to C, B to C).
1Complete linkage (maximum distance). The distance from Z to C is the maximum of the distances ( A to C, B to C).
2Average-distance-within-clusters method. The distance from Z to C is the average distance of all objects that would be within the cluster formed by merging clusters Z and C. This average may be computed according to formulas given by Anderberg (1973, page 139).
3Average-distance-between-clusters method. The distance from Z to C is the average distance of objects within cluster Z to objects within cluster C. This average may be computed according to methods given by Anderberg (1973, page 140).
4Ward's method: Clusters are formed so as to minimize the increase in the within-cluster sums of squares. The distance between two clusters is the increase in these sums of squares if the two clusters were merged. A method for computing this distance from a squared Euclidean distance matrix is given by Anderberg (1973, pages 142-145).

In general, single linkage will yield long thin clusters while complete linkage will yield clusters that are more spherical. Average linkage and Ward's linkage tend to yield clusters that are similar to those obtained with complete linkage.

Class ClusterHierarchical produces a unique representation of the binary cluster tree via the following three conventions; the fact that the tree is unique should aid in interpreting the clusters. First, when two clusters are joined and each cluster contains two or more data points, the cluster initially formed with the smallest level becomes the left son. Second, when a cluster containing more than one data point is joined with a cluster containing a single data point, the cluster with the single data point becomes the right son. Third, when two clusters containing only one object are joined, the cluster with the smallest cluster number becomes the right son.

Comments

  1. The clusters corresponding to the original data points are numbered from 1 to npt, where npt is the number of rows in dist. The npt - 1 clusters formed by merging clusters are numbered npt + 1 to npt + (npt - 1).
  2. Raw correlations, if used as similarities, should be made positive and transformed to a distance measure. One such transformation can be performed by setting argument transform, with transform = 2.
  3. The user may cluster either variables or observations with ClusterHierarchical since a dissimilarity matrix, not the original data, is used. Class Dissimilarities may be used to compute the matrix dist for either the variables or observations.

Requirements

Namespace: Imsl.Stat

Assembly: ImslCS (in ImslCS.dll)

See Also

ClusterHierarchical Members | Imsl.Stat Namespace | Example 1