|
Making the Most of Multiple-Choice Items:
Guidelines for Authors of CEU Articles
The Stem
-
State the question at the level of the arborist. The test items developed
should test the appropriate knowledge, skills, and ability needed by the
arborist at the time of certification.
-
Avoid terminology that is not important to knowledge or ability to perform the
job. Keep the difficulty- and comprehension-levels as simple as possible. For
problems involving computation, keep the values as simple as possible while
still testing the desired skill.
-
Avoid asking the arborist's opinion, attitude, or feelings.
The Alternatives/Options
-
Use four alternatives/options for each test item to lower the probability of
getting the item correct by guessing.
-
Avoid options that appear unrelated to the job. Each item should be a
reasonable question to ask based on the knowledge and skill required for
successful performance of the job.
-
There must be one and only one correct or clearly best answer.
-
Use the alternatives "none of the above" and "all of the above" sparingly and
only when the keyed answer can be classified clearly as right or wrong. When
these options are used, they should occasionally be the correct response for
the item.
-
Use a negatively stated item (for example, "least", "not", "never") only
sparingly.
-
Avoid options that are based on careless reading by the arborist (for example,
wrong unit of measure or using the word "most" rather than "least"). Avoid
trick questions.
The First Step: Writing the Stem
-
When possible, state the stem as a direct question rather than as an incomplete
statement.
Poor:
A commercial dishwashing machine shall be connected to its
drain...
Better:
How would a commercial dishwashing machine be connected to its
drain?
-
Present a definite, explicitly, and single question or problem in the stem. Be
sure the stem of the item clearly formulates a problem.
Poor:
Psychology...
Better:
The science of mind and behavior is called...
Poor:
The cell islets of the pancreas a.
contain ducts
b. produce insulin
c. disappear as one grows older
d. are located around the edge of the pancreas
Better:
The cell islets of the pancreas secrete the substance called
a. trypsin
b. insulin
c. secretin
d. adrenaline
-
State the stem as concisely as possible, eliminating excessive verbiage or
irrelevant information. Include in the stem only the material needed to make
the problem clear and specific.
Poor:
While ironing her formal, Jane accidentally burned her hand on
the hot iron. This was due to a transfer of heat by ...
Better:
Which of the following ways of heat transfer explains why Jane's
hand was burned after she touched the hot iron?
-
Include as much of the question or statement as possible in the stem and keep
options as short as possible. Include in the stem any word or words that might
otherwise be repeated in each alternative.
Poor:
Sump pumps, which lift water from footing tiles or similar
groundwater sources, shall not
a. discharge to storm sewers
b. discharge to natural waterways
c. discharge to sanitary sewers
d. discharge to the outdoors
Better:
Sump pumps, which lift water from footing tiles or similar
groundwater sources, shall NOT discharge to
a. storm sewers
b. natural waterways
c. sanitary sewers
d. the outdoors
-
Use a negatively stated item only sparingly. When a negative word is used in a
stem, it should be underlined, capitalized, or put in boldface type to call
attention to it. A negatively stated stems uses such words as "least", "never"
and "not".
Poor:
Which type of vacuum breaker may not have a control valve
downstream of its outlet?
Better:
Which type of vacuum breaker may not have a control valve
downstream of its outlet?
-
Avoid the use of double negatives.
Poor:
Of the following, the one that is never a function of the
stem of plants is
a. support
b. food storage
c. photosynthesis
d. none of the above
Giving Away the Answer
Be careful the item does not give unintentional clues to the
correct or incorrect answers. Such clues evolve from various weaknesses in the
options. Some of these clues are listed below and should be avoided when the
item writers are developing options for the multiple-choice question.
-
An alternative that is not plausible or attractive to the less knowledgeable or
skillful applicant may give a clue to the correct option.
Poor:
About how many calories are recommended daily for a girl, age
14, height 62 inches, weight 103 lb., moderately active?
a. 0
b. 2,000
c. 2,500
d. 30,000
Better:
About how many calories are recommended daily for a girl, age
14, height 62 inches, weight 103 lb., moderately active?
a. 1,500
b. 2,000
c. 2,500
d. 3,000
-
An option that is longer than the others may suggest the correct answer. The
extra length is often the result of stating the assumptions that are essential
to making the option correct.
Poor:
The most general cause of low incomes in the United
States is
a. lack of valuable productive services to sell
b. unwillingness to work
c. automation
d. inflation
Better:
The most general cause of low incomes in the United
States is
a. lack of valuable productive services to sell
b. the population's overall unwillingness to work
c. the nation's increased reliance on automation
d. an increasing national level of inflation
-
An option that does not follow grammatically from the stem may indicate an
incorrect response.
Poor:
A chain of islands is called an
a. archipelago
b. peninsula
c. continent
d. isthmus
Poor:
Penicillin is obtained from a
a. bacteria
b. mold
c. coal-tars
d. tropical tree
-
An item that uses similar terminology in the correct option and the stem may be
attractive to someone searching for the correct answer.
Poor:
Which type of vacuum breaker may not have a control valve
downstream of its outlet?
a. reduced pressure principal breaker
b. double-check valve assembly
c. atmospheric vacuum breaker
d. double-check with atmospheric vent
-
Two options that are synonymous automatically disclose that both are incorrect.
Poor:
The function of the memory of a personal computer is to
a. retrieve information
b. store data
c. calculate mathematical solutions
d. compute mathematical solutions
|