Abstract: In order to improve the performance of relay protection in substations, this paper proposes a test model construction method, which decouples the functions of protection devices from test items and realizes the standardization of test models for protection devices of nearly a hundred program versions from different manufacturers of the same type. Based on substation configuration description (SCD) files and standard models, an automatic instantiation method is proposed in this paper to solve the problems of low efficiency and poor compatibility of manual configuration of traditional test templates. A specification for the calibration data interaction interface based on Bluetooth protocol is put forward, which completes the closed-loop control of the whole process of on-site calibration and realizes efficient interaction of calibration data. This paper establishes an automatic test implementation process for all types of relay protection that meets safety boundary conditions. This process has been verified in on-site acceptance and regular calibration of relay protection, improving the intelligent maintenance level of relay protection and the quality of on-site operation.