The trend of the use of open softwares is increasing daily. Despite these increases in the use of open softwares, the importance of the problem of their quality is not considered enough. Also, if we look at the existing evaluation model which is used as the evaluation model of the existing open software, the level of the quantization is insufficient, the evaluator can show some subjectivity and as a clear evaluation method is not published, there are many problems to apply it in practice. Therefore, in this study, we have built an evaluation basis that can show consistent quantization without the influence of the evaluator and that can improve the evaluation speed with the automatization of the evaluation information acquisition. The built quality evaluation model will take an important role to evaluate and to improve the open software.