Residual stress by welding should be reduced because that decreases the reliability on strength of welded structure. The reason is that the total stiffness of structure decreases by non-linear behavior of weldment under external load. The release of residual stress by mechanical loading and unloading is often performed in the fabrication of box structure for steel bridge. The proper degree of loading and unloading is significant at release method of residual stress by mechanical loading because that degree is changed by material and geometric shape of welded structure. Therefore, the simulation model that could exactly analyze the release of residual stress by mechanical loading is to be necessary. This simulation model should be established on the based of variable and accurate measurement data. In this study, the non-linear behavior of weldments under external loading and unloading, such as the decrease and increase of structure stiffness, was investigated by monitoring of nominal stress and strain. Tensile loading and unloading test under variable load was performed and the proper degree of stress relaxation was measured by sectioning technique using strain gauge.