To accurately extract phase from the noisy interferograms, an adaptive wrapped Kalman filter phase unwrapping algorithm based on Zernike polynomial fitting is proposed in the paper. The phase map is modeled as Zernike polynomial fitting, the fitting coefficients are accurately calculated using wrapped Kalman filter with a quadratic difference weighting strategy for the phase map, and the measurement noise covariance matrix is adaptively adjusted by the innovation of the predicted and measured states without setting different observed noises according to the interferogram. The results of simulation and experiment show that the proposed method can effectively deal with the noisy interference fringe and retrieve the phase map, and is superior to the least square method and Kalman filter for phase unwrapping of noisy interferograms, which has the advantage of good robustness and no need for pre-filtering and manual intervention.