The strength and the life of welded components are affected extensively by the residual stresses distributed around their weldments not only under static loads, but also fatigue loads. The residual stress can be superimposed with externally applied loads, so that unexpected deformations and failures of members will be occurred. These residual stresses are not kept constant, but relaxed or redistributed during in service. Under static loads the relaxation takes place when the external stress superimposed with the residual stress exceeds locally the yield stress of material used. It is shown that under fatigue loads the residual stress is considerably relieved by the first or flew cycle loading, and then gradually relaxed with increasing loading cycles. In this study the phenomenon and mechanism of the stress relaxation by mechanical means were investigated and a model to predict quantitatively the residual stress relaxation for the case of static and fatigue loading condition was proposed.