A new reduction method of residual stress in welding joint is proposed where welded metals are shaken during welding. By an experiment using a small shaker, it can be shown that tensile residual stress near the bead is significantly reduced. Since tensile residual stress on the surface degrades fatigue strength for cumulative damage, the proposed method is effective to reduction of residual stress of welded joints. The effectiveness of the proposed method is demonstrated by the response analysis using one mass model with nonlinear springs.