The bound state wave functions for all the known exactly solvable potentials can be expressed in terms of orthogonal polynomials because the polynomials always satisfy the boundary conditions with a proper weight function. The orthogonality of polynomials is of great importance because the orthogonality characterizes the wave functions and consequently the quantum system. Though the orthogonality of orthogonal polynomials has been known for hundred years, the known orthogonality is found to be inadequate for polynomials appearing in some exactly solvable potentials, for example, Ginocchio potential. For those potentials a more general orthogonality is defined and algebraically derived. It is found that the general orthogonality is valid with a certain constraint and the constraint is very useful in understanding the system.