P-values are often perceived as measurements of degree of compatibility between the current data and the hypothesized model. In this paper, a new concept of Bayesian p-values is proposed and studied under the non-informative prior distributions, which can be thought as the Bayesian counterparts of the classical p-values in the sense of using the concept of significance level. The performances of the proposed Bayesian p-values are compared with those of the classical p-values through several examples.