In this paper, we suggest a method to acquire the moving object centered video by panning and tilting a camera automatically according to motion vectors calculated by detecting the motion of a moving object on video steam. We create a difference image by estimating the intensity difference at the grid points of neighboring frames. And we detect the motion using both horizontal projection histogram and vertical projection histogram and decide the center of motion part. Then we calculate a new direction and degree of the motion by comparing coordinates at the center of current motion and the center of previous motion. By controling the RCM using these Motion vectors, we can get video stream positioned unwire object on the center of video frame. Through the experiments, we could get a moving object centered video stream continuously arid monitor remotely by implementing sever/client architecture based on the web.