We have developed a vision based crack detection system and algorithm to inspect base side of bridges. After human operator decides from vision images captured if lines on base side are cracks or dirt, our algorithm finds automatically the length, the width and the shape of cracks. The system has been tested with a robot extender on a truck in real environment and has been proved to be very useful to reduce inspection cost as well as the data management.