Quantitative information of a three dimensional(3D) kinematics of joint is very useful in knee joint surgery, understanding how knee kinematics related to joint injury, impairment, surgical treatment, and rehabilitation. In this paper, an automated 2D/3D image matching technique was developed to estimate the 3D in vivo knee kinematics using dual X-ray images. First, a 3D geometric model of the knee was reconstructed from CT scan data. The 3D in vivo position and orientation of femoral and tibial components of the knee joint could be estimated by minimizing the pixel by pixel difference between the projection images from the developed 3D model and the given X-ray images. The accuracy of the developed technique was validated by an experiment with a cubic phantom. The present 2D/3D image matching technique for the estimation of in vivo joint kinematics could be useful for pre-operative planning as well as post-operative evaluation of knee surgery.