This paper proposes an enhanced adaptive mode decision scheme for fast H.264 encoders. By efficiently predicting AZCB (All Zero Coefficient Block), the proposed scheme can encode motion pictures in H.264 up to 2.86 and 1.68 times faster than JM9.3 and AMD [1], respectively. Besides, this scheme significantly reduces the encoding performance fluctuation of AMD across tested bit-rates and video sequences.