In this study, it was investigated the distribution of residual stress in the direction of loading between the root and toe the load fillet welds for thick steel plate. Residual stress distributions are measured by sectioning method which is one of stress-relaxation technique in welded joint, and analyzed by two dimensional finite element method on thermo-elasto-plastic theory under plane stress condition. These are compared the results of F.E.M analysis with the experimental result by stress-relaxation techniques. As a results, the following conclusion were obtained. (1) In the no penetration fillet welded joint specimen using mild steel plate with 25mm in thickness, the residual stress of loading direction near the root was about $10kg/mm^2$ tensile. (2) The tensile residual stress has been observed in fillet region of the fillet joint by F.E.M. analysis method. (3) The range of compressive residual stress distribution from the root was largest in the case of 5mm root penetration.