Aiming at the current problems of limited stability and accuracy and high complexity of each solution in non-contact vital signs measurement, a non-contact vital signs measurement method based on matched filtering is designed to achieve low computational complexity and maintain optimality estimation. Five samples are tested in an office environment, and the results show the effectiveness of the proposed method to reduce the vital sign measurement errors due to people′s body movements in real environments. As an example, for sample 4, the variance of heart rate decreases from 2 825 to 82 in the smoothness design, and the root mean square error of heart rate decreases from 16 to 4 in the accuracy tracking calibration design. Clinical experiments are further compared with the current medical reference standards, and the results show that the respiratory rate error is within 1 bpm, while the heart rate measurements are better, which makes it potentially useful.