This paper proposes the image segmentation algorithm to extracts a fish object from a fish image for fish image retrieval. The conventional algorithm using gray level similarity causes wrong image segmentation result in the boundary area of the object and the background with similar gray level. The proposed algorithm uses the reinforced edge and the adaptive block-based threshold for the boundary area with weak contrast and the virtual object to improve the eroded or disconnected object in the boundary area without contrast. The simulation results show that the percentage of extracting the visual-fine object from the test images is under 90% in the conventional algorithm while it is 97.7% in the proposed algorithms.