The purpose of this paper is to calculate the excavation volume of unequal interval grid using nonlinear boundary in eathwork volume determination for reclamation of the foreshore. A congruence area formula by first and third equation is compared with trapezoidal, simpson formulas to earthwork volume. And nonlinear spot level method of unequal interval grid is compared with linear and nonlinear spot level method of equal interval grid excavation volume. As a result algorithm of derived area and volume formula should provide a better accuracy than linear and nonlinear spot level currently in use. Practical application of each method to the excavation volume is illustrated by digital elevation model of aerial photogrammetry and model test of aquarium.