This study proposes an automatic method to generate 3D building models using a draft map, which is an intermediate product generated during the map generation process based on aerial photos. The proposed method is to generate a terrain model, roof models, and wall models sequentially from the limited 3D information extracted from an existing draft map. Based on the planar fitting error of the roof corner points, the roof model is generated as a single planar facet or a multiple planar structure. The first type is derived using a robust estimation method while the second type is constructed through segmentation and merging based on a triangular irregular network. Each edge of this roof model is then projected to the terrain model to create a wall facet. The experimental results from its application to real data indicates that the building models of various shapes in wide areas are successfully generated. The proposed method is evaluated to be an cost and time effective method since it utilizes the existing data.