This paper presents the coexistence issues between M-WiMAX TDD and WCDMA FDD systems. To improve the M-WiMAX system performance and to reduce the adjacent channel interference to WCDMA FDD system, transmit and receive beamforming techniques are applied in the base stations of M-WiMAX system. Furthermore, we propose an adjacent channel interference modeling methodology, which captures the effect of transmit beamforming on the adjacent channel interference. Besides, we verify the performance improvement in the uplink of WCDMA system due to the transmit beamforming in M-WiMAX downlink based on the proposed adjacent channel interference modeling methodology. We also verify the performance enhancement due to the receive beamforming in the uplink of M-WiMAX system through system level Monte Carlo simulations, considering random user position, the effect of shadowing and multi-path fading channel. Discussions on the gain of applying transmit and receive beamforming in M-WiMAX system comparing the case of SISO system are also included. Furthermore, we present the performance of cosited M-WiMAX and WCDMA systems, considering commercial deployment, additional channel filter at base stations and the effects of TxBF and RxBF.