An automatic design method of behaviors in behavior-based robotics is proposed. With this method, a robot can design its behaviors by itself without aids of human designer. Automating design procedure of behaviors can make the human designer free from somewhat tedious endeavor that requires to predict all possible situations in which the robot will work and to design a suitable behavior for each situation. A simple reinforcement learning strategy is the main frame of this method and the key parameter of the learning process is significant change of reward value. A successful application to mobile robot navigation is reported too.