Ancient Buddhist temples in China began to be built in the $3^{rd}$ century, and numerous temples were built during the Six Dynasties period (420-589 AD). The site layouts of only about five temples built between the late $5^{th}$ and late $6^{th}$ centuries have been identified through excavation. These temple sites have a single pagoda/image hall style and reveal a process of change over this 100-year period. This paper describes in detail how these five temple sites, despite having the same single pagoda/image hall form, show differences and changes. The underlying reasons for and significance of this process of change are also investigated. These sites demonstrate well the process by which temple layouts changed from a pagoda-centered arrangement to an image hall-centered arrangement. This development is closely connected to Korean Buddhist architectural plans during the same period.