TB 9-6695-294-35
Table 1. Calibration Description - Continued
Test instrument parameters
Performance specifications 1
Range: 0 to 10 MΩ
Range (in ohms):
Accuracy: (% of reading + % of range)
10
.006 + .01
100 through 1 M
.01 + 0
10 M
.02 + .001
1Listed
specifications are in accordance with MIS- 35947 and do not agree with manufacturer's published
specifications.
2Not to exceed a volts-hertz product of 107.
SECTION II
EQUIPMENT REQUIREMENTS
procedure. This equipment is issued with Secondary Transfer Standards Set, AN/GSM-286.
Alternate items may be used by the calibrating activity. The items selected must be verified to perform
satisfactorily prior to use and must bear evidence of current calibration. The equipment must meet or
exceed the minimum use specification listed in table 2. The accuracies listed in table 2 provide a four-to-
one ratio between the standard and TI. Where the four-to-one ratio cannot be met, the actual accuracy
of the equipment selected is shown in parenthesis.
accessories, issued as indicated in paragraph 4 above, and are not listed in this calibration procedure.
Table 2. Minimum Specifications of Equipment Required
Minimum use
Manufacturer and model
Common name
specifications
(part number)
CALIBRATOR
Dc volts: 100 mV to 1000 V
John Fluke, Model 5700A/CT
Accuracy: 12.5 ppm(17 ppm at 100 mV)
(P/O MIS-35947) w/amplifier,
John Fluke, Model5725A
Resistance: 10 Ω to 10 MΩ
(5725A)
Accuracy: 10 Ω: 40 ppm
100 Ω to 1 MΩ: 25 ppm
10 MΩ: 52.5 ppm
Frequency: → (Hz)
Accuracy: ↓ (%)
Ac Volts
30
40
1k
10 k
30 k
90 k
100 mV
(0.034)
---
(0.021)
0.0412
0.07
(0.12)
300 mV
(0.028)
---
0.0125
0.0225
0.06
0.06
1V
0.026
---
0.0125
0.0225
0.06
0.06
3V
(0.028)
---
0.0125
0.0225
0.06
0.06
10 V
0.026
---
0.0125
0.0225
0.06
0.06
100 V
0.026
---
0.0125
0.0225
0.06
(0.07)
500 V
---
0.0275
0.0163
0.0412
---
---
600 V
---
---
0.0187
---
---
---
1000 V
---
0.0275
---
0.0412
---
---
3
