The cosmological perturbations induced by primordial magnetic fields and its influence on cosmic microwave background (CMB) radiation will be discussed. In particular, CMB temperature anisotropies, polarization, and temperature-polarization cross correlations, as well as Faraday rotation effect will be presented. The possible observational CMB tests to detect primordial magnetic fields will be discussed.