In binary digital transmission system the band-limiting is required for the better transmission efficiency. But in the case of band-limiting the intersymbol-interference (ISI) usually takes place. In this paper, in an attempt to design band-limiting filter which has minimum ISI and maximum stop-band loss, first, making use of analog filter by combining Binary Transversal Filter (BTF) and analog filter (4th Butterworhfilter), we found the value that minimizes ISI phenomenon by getting step response of rectangular pulse resulting from BTF in time domain. Second, we found filter characteristic we want to in frequency domain for band-limiting and minimized the error. And then we obtained resistor value (Tap coefficient) in order to design algorithm for optimum filter. Also we showed the example of simulation in case we established the resistors with 3,5 and 7 respectively. With 7 resistors set, we identified that the ripple of about minus 30dB was taken place.