Construction projects have become increasingly complex in recent years, resulting in substantial safety hazards and frequent fall accidents. In an attempt to prevent fall accidents, various safety management systems have been developed. These systems have mainly been evaluated qualitatively and subjectively by practitioners or supervisors, and there are few tools that can be used to quantitatively evaluate the performance of safety management systems. We propose an expertise-based safety performance evaluation model (EXSPEM), which integrates a fuzzy approach-based analytic hierarchy process and a regression approach. The proposed model uses S-shaped curves to represent the degree of contribution by subjective expertise and is verified by a genetic algorithm. To illustrate its practical application, EXSPEM was applied to evaluate the safety performance of a newly developed real-time mobile detector monitoring system. It is expected that this model will be a helpful tool for systematically evaluating the application of a robust safety control and management system in a complex construction environment.