This paper proposes an algorithm to obtain the time-to-contact between an observer and a target and surface orientation of the target. These two physical elements are computed from the image deformation of a known shape, which is extracted by supervised classification of detected line segments based on MAP and Mahalanobis distance. The proposed algorithm was applied to the natural outdoor traffic scene and would contribute to the development for a collision avoidance system.