In this paper, we propose a method that can compensate the geometric distortions of image caused from an arbitrary nonflat display surface(or wall) under the environment of portable overhead projector without a flat screen. In the proposed method, we first project a grid pattern to an arbitrary nonflat display surface and then derive an equation of straight line that represents the geometry relationship between the distorted grid pattern and the original grid pattern. Next, after determining the proper size of the original grid pattern according to the form of the display surface, we generate a compensation pattern from the derived equation of straight line, which can symmetrically compensate for the distorted image. Finally, we compensate for the geometric distortions of the projected image by segmenting the real image to be projected from portable overhead projector and prewarping it according to the compensation pattern. To evaluate the proposed method, we performed experiments of image compensation on inclined surface, bent surface and curved surface that are frequently occurred in the environment of portable overhead projector without a flat screen. From the experimental results, we found that the proposed method could be very effective in compensating for the general types of the geometric distortions of the projected images.