Three dimensional city model is composed of man-made and natural features, among these, most of man-made features are buildings. Therefore, it is very important to extract the building informations accurately and promptly to update the existing database. To achieve this, DTM can be reconstructed using building Information which is extracted from DTM, then this can be used as three dimensional city model. Thus, this paper aims to extract building boundaries and heights from high resolution DTM and edge informations of aerial photograph using mathematical morphology and image segmentation. We found that it is possible to extract buildings using opening operation in mathematical morphology and to improve the accuracy of building extraction using edge informations from aerial photograph.