TB 9-6625-2361-35
Table 1. Calibration Description - Continued
Test instrument
parameters
Performance specifications
Ac volts
Range: 0 to 1000 V
True rms ac volts
Accuracy: (% of reading + % of FS)
(option 09A)
% of input
% FS
10
to 20
Hz
2.0
0.08
20
to 50
Hz
1.0
0.04
50 Hz to 10
kHz
0.2
0.04
10
to 30
kHz
0.4
0.08
30
to 50
kHz
0.6
0.6
50
to 100 kHz
2.0
0.6
100
to 300 kHz
2.8
1.0
300 kHz to 1
MHz
3.7
2.1
NOTES:1. Slow filter must be used for full accuracy below 400 Hz.
2. Volt-hertz product not to exceed 2 x 107 for 100 V and 1000 V
ranges and 1 x 107 for 1 V and 10 V ranges.
3. For inputs above 500 V, multiply accuracy by: (2000V + V in)
2000V
Resistance (option 02)
Range: 10 Ω to 100 mΩ
Accuracy: (% of input + No. digits)
Normal resolution
High resolution
Range (Ω)
10
0.01 + 20
---
100
0.006 + 2
0.006 + 14
1k
0.006 + 1
0.006 + 8
10 k
0.006 + 1
0.006 + 8
100 k
0.006 + 1
0.006 + 8
1M
0.006 + 1
0.006 + 8
10 M
0.04 + 1
0.04 + 8
100 M
0.1
+1
0.1
+8
EQUIPMENT REQUIREMENTS
calibration procedure. This equipment is issued with Secondary Transfer Calibration
Standards Set AN/GSM-287 or AN/GSM-705. Alternate items may be used by the
calibrating activity. The items selected must be verified to perform satisfactorily prior to
use and must bear evidence of current calibration. The equipment must meet or exceed the
to-one ratio between the standard and TI. Where the four-to-one ratio cannot be met, the
actual accuracy of the equipment selected is shown in parenthesis.
usage accessories, issued as indicated in paragraph 4 above, and are not listed in this
calibration procedure.
