Longitudinal deformation is produced by fillet welding during the fabrication of built-up beams and decreases productivity and quality because it needs an extra correcting process. The deformation is caused by welding moment, which is the value multiplied the welding shrinking farce by the distance from the neutral axis. This welding moment can be offset by generating a moment in the same magnitude and in an opposite direction by induction heating. The location and quantity of the induction heating are decided via experiments and simple equations. This study, first, clarifies the creation mechanism of the longitudinal deformation with FEM analysis. Then, we presents the preventive method of this deformation by induction heating basing on the mechanism and verifies its validity through analysis and experiments.