During the last three decades, a few attentions have been paid for investigating the cost distribution for the optimal maintenance problems. In this article, we derive the moment of the discounted cost distribution over an infinite time horizon for the basic age replacement problem. With first two moments of the discounted cost distribution, we approximate the underlying distribution function by three theoretical distributions. Through a Monte Carlo simulation, we conclude that the log-normal distribution is the best fitted one to approximate the discounted cost distribution.