The requirement of rehabilitation is increasing from the stroke, spinal cord injury. One of the most difficult part is the upper limb rehabilitation because of its nervous complexity. A rehabilitation has effectiveness when a professional therapist treats in work at facility, but it has problems of an accessibility, a constant availability, a self-participation and taking lots of cost and time. In this paper, we test and experiment the accuracy and execution time of the pattern recognition algorithms like PCA, ICA, LDA, SVM to show the recognition possibility of it on the upper limb function from the 3D trajectory information which is gathered from stereo vision sensor(Kinect). From the result, PCA, ICA have low accuracy, but LDA, SVM have good accuracy to use for physical rehabilitation on the upper limb function.