While the ‘Me Too’ movement spread internationally, testimony and disclosure are widely made on the facts of sexual violence in the world of sports as well as the world of culture and art. Especially, the recent reports on a case in which an athletic leader sexually assaulted a minor athlete in the world of sports and a case in which a sports coach sexually assaulted a member of the national team habitually have a great impact on the society. Since a sex offense has a strong tendency of the violation of human rights, it gives much pain to victims, and the victims are reluctant to let the others know the fact of their damage, so there are a lot of hidden crimes. Especially, in most of the violence and sexual violence occurring in the world of sports, the assailant has considerable power, and victims cannot but follow the assailant’s instruction and supervision, so despite the offense is done against the victims’ intent, they cannot express active intention to refuse that. In this case, the establishment of adultery by abuse of occupational authority is denied, so there is a problem that neither proper punishment of the assailant nor the protection and support of the victim are made. Thus, this study assessed the present status of sexual violence in the world of sports to seek a measure for eradicating sexual violence in the world of sports and discussed problems and solutions in coping with that. Especially, this study focused on the re-examination of the components of a sex offense to fill the deficit of punishment on sexual violence in the world of sports.