In this article, an optimal control problem associated with convection-diffusion equation is considered. Using Lagrange multiplier, the optimality system is obtained. The derived optimal system becomes coupled, non-symmetric partial differential equations. For discretizations and implementations, the finite element multigrid V-cycle is employed. The convergence analysis of finite element multigrid methods for the derived optimal system is shown. Some numerical simulations are performed.