In this research, the optimal manufacturing conditions of fine Si powders from Si scrap were investigated as a function of different initial powder size using the high-energy ball milling equipment, which produces the fine powder by means of an ultra high-energy within a short duration. The morphological change of the powders according to the milling time was observed by Scanning electron microscopy (SEM). With the increasing milling time, the size of Si powder was decreased. In addition, more energy and stress for milling were required with the decreasing initial powder size. The refinement of Si scrap was rapidly carried out at 10min ball milling time. However, the refined powder started to agglomerate at 30 min milling time, while the powder size became uniform at 60 min milling time.