In order to solve the problem as ringing effect induced by neglect of the image contrast feature in many current remote sensing image fusion methods, this paper uses the standard deviation information of the image to measure the contrast characteristics of the image, and then realizes image fusion. Hue, saturation, value（HSV） color model is introduced to extract V factor of multispectral image. With the help of NSCT, the different coefficients of V factor and panchromatic image are calculated. Then, the saliency factor of the image is obtained by Fourier transform, and combined with the regional energy characteristics of the image to form the fusion rules of lowfrequency coefficients, so as to realize the fusion of lowfrequency information. By using the standard deviation information of the image to measure the contrast characteristics of the image, and combining it with the average gradient information of the image, the fusion rules of high frequency coefficients are formed to realize the fusion of high frequency information. Finally, it is reconstructed by inverse NSCT to update the V factor. The updated V factor, combined with H factor and S factor of MS image, is reconstructed by inverse HSV color model, and the result is concordant. The experiments show that compared with the current remote sensing image fusion technology, this algorithm has higher spectral correlation coefficient and information entropy.