Benchmarking therapists: furthering the benchmarking method in its application to clinical practice

Psychotherapy research has been interested in understanding the variability observed among therapists with regard to their treatment effectiveness. An important initial step towards understanding the source of the differences is to reliably identify therapists that are effective. The current paper thus proposes a method for benchmarking therapists against predetermined criteria of effectiveness which could be conducted using any standard statistical package. Basic steps include (a) creating benchmark(s), (b) determining a prior the numerical criteria that constitute as ??effective?? based on the benchmark(s), (c) calculating pre-post effect sizes as an indicator of effectiveness at the case level using statistical adjustments so as to best match clinical (and other) differences among cases, and (d) statistically benchmarking the therapists using a random-effects hierarchical linear modeling. An example is provided that highlights the number of therapists who would be classified as effective based on various numerical criteria and confidence levels.