Hippocampus is an important part of brain which is related with early memory storage and spatial navigation. By observing the anatomy of hippocampus, some brain diseases effecting human memory (e.g. Alzheimer, schizophrenia, etc.) can be diagnosed and predicted earlier. The diagnosis process is highly related with hippocampus segmentation. In this paper, hippocampus segmentation using Active Shape Model, which not only works based on image intensity, but also by using prior knowledge of hippocampus shape and intensity from the training images, is proposed. The results show that ASM is applicable in segmenting hippocampus from whole brain MR image. It also shows that adding more images in the training set results in better accuracy of hippocampus segmentation.