In this study, a mild steel (SS41) of the carbon steel, a spring steel (SUP-9), and stainless steel (SUS 304) of the special gceel, etc, are adopted as the experimental materrials and are weded by $CO_2$(SS41, SUP-9), TIG (SUS304), respectively. And the residual stress distribution and fracture behavior at the welded zone are examined according to annealing temperatures of four section involving as welded. As a consequence, the best annealing temperatures that the residual stress is removed enough and mechanical properties are very suitable are at 90$0^{circ}C$ (SS41), 75$0^{circ}C$ (SUP-9), 110$0^{circ}C$ (SUS 304), respectively.