When the topology optimization is applied to the design of compliant mechanism, unexpected displacements of input and output port are generated since the displacement control is not included in the formulation. To devise a more precise mechanism, displacement constraint is formulated using the mutual potential energy concept and added to multi-objective function defined with flexibility and stiffness of a structure. The optimization problem is resolved by using Finite Element Method(FEM) and Sequential Linear Programming(SLP). Design examples of compliant mechanism with displacement constraint are presented to validate the proposed design method.