Diblock copolymers with different poly($varepsilon$-caprolactone) (PCL) block lengths were synthesized by ringopening polymerization of $varepsilon$-caprolactone in the presence of monomethoxy poly(ethylene glycol) (mPEG-OH, MW 2000) as initiator. The self-aggregation behaviors of the diblock copolymer nanoparticle, prepared by the diafiltration method, were investigated by using $^1H$ NMR, dynamic light scattering (DLS), and fluorescence spectroscopy. The PEG-PCL block copolymers formed the nano-sized self-aggregate in an aqueous environment by intrsa- and/or intermolecular association between hydrophobic PCL chains. The critical aggregation concentrations (cac) of the block copolymer self-aggregate became lower with increasing hydrophobic PCL block length. On the other hand, reverse trends of mean hydrodynamic diameters were measured by DLS owing to the increasing bulkiness of the hydrophobic chains and hydrophobic interaction between the PCL microdomains. The hydrodynamic diameters of the block copolymer nanoparticles, measured by DLS, were in the range of 65-270 nm. Furthermore, the size of the nanoparticles was scarcely affected by the concentration of the block copolymers in the range of 0.125-5 mg/mL owing to the negligible interparticular aggregation between the self-aggregated nanoparticles. Considered with the fairly low cac and nanoparticle stability, the PEG-PCL nanoparticles can be considered a potential candidate for biomedical applications such as drug carrier or imaging agent.