In school education, the evaluation plays an important role for the accomplishment of
educational goal and for the planing of education. Thus, the achievement evaluation item
should have high validity. The achievement evaluation items should appropriate for the
educational goal and include all the learning contents. Although the validity of achievement
evaluation items is very important, little research was performed on how much the evaluation
items of high school chemistry course really have the content validity. Therefore, in this study
we analyzed the validity of the chemistry achievement evaluation items used in schools in the
dimension of behavior and content. For this, 5 different high schools were selected that used
the same publisher\'s chemistry I textbook, and the middle semester achievement evaluation
items were gathered. First, 34 instructional objectives were classified into the behavior domain
and the content domain from the \'water\' chapter in the textbook and the teacher\'s guide.
Second, 121 evaluation items were classified into the behavior domain and the content domain.
Third, the analysis of the ratio difference method were performed between the instructional
objectives and the evaluation objectives. From the results, it was found that content validities
of the behavior domain were low, but those of the content domain were high. These results
implies that more effort should be paid to raise content validities of the behavior domain in
achievement evaluation of high schools. Especially, the test items should be developed on the
high level thinking skill such as analysis, synthesis, and evaluation. This study tells it is
necessary to develop in-service teacher education program to raise the professionality of
teachers on the evaluation items.