neurocareusa.com

home < temperament and personality typing < on the validity of tests used in typing (2006)
neurocare home <

(March, 2007 Note: Most of my articles on temperament, dreams, psychology, etc. are now hosted at www.neurocareusa.com. Go there for the latest version of articles. However, the links to old versions are still functional.)

"On the Validity of Tests Used in Typing"
by Robert I. Winer, M.D.

Tests Used Validity Different Scores, Different Assessments A New Tool
Reliability Accuracy Two Different Tools

Personality test assessment is typically done through the subject answering verbal or written questions. Since people's responses at any given moment may reflect their both their conscious current life situation and mindset and their unconscious reaction to this, it is important to have tests that are accurate and reliable across individuals and time. In this way, an objective tool is created which can be used for research. Though such a vehicle may be statistically accurate, it should be remembered that such testing may be individually inaccurate from the standpoint of total personality, conscious and unconscious.

This paper is based upon an article (Berens, L., "Type & Temperament," Bulletin of Psychological Type, 19:2 (Spring 96): p.8-9.) and freely uses excerpts. This article covered the most widely used testing instruments and is for the more scientifically minded.

Tests Used

return to top

In regard to the United States, the most widely used and popular temperament or typing tests are the Myers-Briggs Type Indicator (MBTI)® and the Keirsey Temperament Sorter both of which are based upon theories that address the innate nature of the conscious personality. These tests seek to assess what has been called, a person's "true type." Finding "true type" enables one to make accurate statements as to a person's perceptual preference, preferred mode of making judgments, and their outward style in relationship to stopping incoming perceptions. Researchers have doumented that when an individual behaves in ways inconsistent with their "true type" that high levels of stress result or, contrarily, that high levels of stress are present in the testing field. Staying close to "true type" means that one is consciously adapting to the present internal and external situation according to their natural temperament.

Both the MBTI and the Keirsey Sorter reflect psychological constructs that have heuristic value. These testing vehicles, based upon the work of Jung, have stood the test of time and a multitude of users.

Reliability

return to top

These tests are also reliable, that is, they work in the same way each time. Correlation of ± .70 between two administrations on test-retest are considered adequate. The MBTI exceeds that requirement. While there is no published data on the Keirsey Sorter, there were initial reliability correlations at an acceptable level.

Validity

return to top

These tests also meet the validity criteria of a correlation range of ± .20 to .60. The MBTI fared well in such correlations, although most of the correlations were with continuous scores on individual scales, not remaining true to Jung's theory of types (whole types, not preference scales). The Keirsey Sorter correlated at an acceptable level with the MBTI. No published data is available.

Accuracy

return to top

These tests are accurate. Both instruments seem to have an "error" rate of at least 25%. When a feedback session is conducted and the client confirms their type, the instrument results do not match the confirmed and/or observed type about 25% of the time. Some practitioners would say it is higher. Inappropriate contexts seem to contribute to this inaccuracy rate. For example, when someone wants a job, they are not likely to be in a frame of mind to accurately self-report. It is not that people intentionally lie; they just do what it takes to survive, sometimes fooling themselves as well. Self-report instruments are more accurate when the client is in need of the information, feels safe and is "motivated" to accurately self-report. Any time a self-report instrument is used in a context where there is even a slight fear of losing one's job or one's self-esteem, the error rate will go up. A good feedback session can mitigate this effect.

2. Different Scores, Different Assessments

return to top
Many people take the MBTI or the Keirsey Sorter at different times. Frequently, they come out differently with each taking. Given what we know about self-report instruments, it is to be anticipated that people will come out differently at different times. First off, there have usually been other kinds of interactions with the frameworks between the administrations. Once one has heard or read an explanation of the temperaments and the preferences, it changes how one views the items. Depending on the mindset and the person's nature, the second taking may be more accurate than the first, it may be skewed by some misconception from the information given, or it may be affected by one's desire to be different and so on.

Two Different Tools

return to top
There are also differences in different tools even though they are developed out of a common theoretical base. The MBTI was developed directly from the work of Carl Jung's work on type. David Keirsey's seems to have constructed his test from the earlier Gray-Wheelwright test developed in the 1930's by two Jungian analysts psychiatrists at Standford University in California. Keirsey published his "Temperament Sorter" in 1978 as a self-help tool in the book, "Please Understand Me." Over the past few years, the test is no longer available to public for free but used in a for-profit setting for the use of business and psychologist. It is also available to individuals for a fee.

The Keirsey Sorter, being significantly shorter and easier to take than the MBTI, is not considered the same. Even though it uses the same language as the MBTI, none of the items are the same. This explains the difference between scores on the two instruments. Neither the Keirsey Sorter nor the MBTI gets at the temperament pattern directly, that is, by looking at the themes and patterns of the four temperaments in the clinical setting.

A New Test

return to top

In 2002, I developed a computer calculation program to change the Gray-Wheelwright three letter type indicator to a four letter type, along the lines of the MBTI. The results were less than satisfactory and there was not a consistent relationship between the type obtained and the other testing vehicles. Therefore I sought to improve the test. In May, the first version of the Gray-Wheelwright-Winer four letter type test was made available to the public. My hope is that this test gain widespread use and that questions regarding its validity be made the subject of scientific study.

(®Myers Briggs Type Indicator and MBTI are registered trademarks of Consulting Psychologists Press Inc.)


Copyright 2006 Robert I. Winer, M.D.