Many of residential buildings, which have pilotis in lower stories to meet the architectural needs, are recently constructed in Korea. Usually, infill walls located in the upper stories of these buildings may cause a soft first story, which is very weak from the earthquake resistance. In the design of the buildings, the infill walls of upper stories are usually considered as non-structural elements and thus they are not included in the analytical model. However, the infill walls may affect the seismic behavior of the residential buildings. Therefore, the differences in seismic behaviors of RC buildings with and without masonry infill walls are required to be investigated. In this study, seismic fragility analyses were performed for masonry infilled low-rise RC moment-resisting frames. And seismic behaviors of RC moment-resisting frame with/without masonry infill walls were evaluated. Two types of structural system with the same frame and different allocation of infill walls are used to evaluate the influence of masonry infill walls on seismic behavior of RC moment-resisting frames. The infill walls were modeled as bi-equivalent diagonal struts. The fragility analyses show that the seismic performance of RC moment-resisting frames with soft story is below the desirable building seismic performance level recommended by current seismic codes, indicating high vulnerability of RC moment-resisting frames with soft story.