Sliding mode control, as a typical method of variable structure control, has the robust characteristics for the uncertainty and the disturbance of the nonlinear system. Because, however, sliding mode control input includes a sign function that Is discontinuous on the predefined switching surface, its applications are primarily limited by the need of alleviation or reduction of chattering. In this paper, we propose a chattering alleviation strategy based on a special nonlinear function and a fuzzy system. By using the proposed control scheme, we can reduce the steady state error. Its tracking performance is as fast as that of conventional method using the fixed boundary layer. Especially, in the proposed method, we can adjust the trade-off between the steady state error and the degree of chattering by regulating the proper range of the output variable of the fuzzy system. To verify the validity of the proposed algorithm, the analysis of the control method using the fixed boundary layer and the computer simulations are shown to compare with them.