Objectives: This study was performed to investigate the influence of family factors on drinking and smoking of middle-aged men. Methods: This study used data from the fourth-wave of the Korean Welfare Panel Study, which was collected by the Korean Institute for Health and Social Affairs and the Social Welfare Research Center of Seoul National University. This study was conducted on 3,084 men who were between 30 and 59. Results: The family factors, except for living with children, affected drinking, heavy drinking, smoking, and current smoking, after controlling for age, education, employment status, and family income. Marital status had statistically significant influences on heavy drinking, smoking, and current smoking. Living without family had influences on drinking, and heavy drinking. family satisfaction affected heavy drinking, smoking, and current smoking. The effects of family conflicts were also statistically significant. Conclusions: Based on the results, this paper can suggest that the projects of moderation in drinking and smoking are required to consider family factors more and the plan of building up family resources should be considered in the whole aspects of the society.