In this paper, the stiffness and damping matrix are experimentally constructed using the structural modal information on frequencies, damping ratio and modal vectors, which are obtained by shaking table tests. Free vibration, harmonic and white noise vibration tests are performed. The acceleration of the shaking table was used as the input signal, and the corresponding accelerations of each floor were measured as output signals. The characteristics and limitations of modal information from each test are compared. The results of this study would be a basic resource of the analytical and experimental studies on the system identification of structures.