The multiple regression analysis and path analysis in each dominant area of noise source are conducted to analyze the relationship between dependent variables like annoyance and independent ones such as noise and non-noise factors. The multiple regression analysis shows that impact of noise factors is the highest to annoyance in dominant areas of road traffic and railway noise. Meanwhile, impact of non-noise factors such as sensitivity and satisfaction of environment on annoyance is also high in these areas. The path analysis result for multivariate analysis between various independent and dependent variables is similar to that of the multiple regression analysis. However, noise factor is the greatest factor influent on annoyance in the dominant areas of the combined noise, and relationship between annoyance and sensitivity is the highest in combined area exposed to road traffic noise and railway noise.