In this research, a controller design method based on optimization is proposed that can satisfy constraints on maximum responses of building structures subject to around excitation modeled by partially stochastic process. The class of controllers to be optimized is restricted to LQR. Weighting matrix on controlled outputs is used as design variable. Objective function, constraint functions and their gradients are computed by the parameterization of control gain with Riccati matrix. Full state feedback controllers designed by proposed optimization method satisfy various design objectives and their necessary maximum control forces are computed for the production of actuator. LQG controllers composed of Kalman filter and LQR designed by proposed method perform well with little deterioration. So it is possible to design output feedback controllers satisfying constraints on various maximum responses of structures.