TB 9-6625-114-24
Table 1. Calibration Description - Continued
Test instrument
Performance specifications
parameters
Meter Mode:
DC Voltage:
Range: 300 mV, 3, 30 and 300 V
Accuracy: (0.5% rdg + 5 LSD)
AC Voltage:
Range: 300 mV, 3, 30 and 250 V
Accuracy: (1% rdg + 10 LSD), 50 to 60 Hz; (2% rdg + 15 LSD), 20 Hz to
20 kHz; (3% rdg + 20 LSD), 5 Hz to 1 MHz
Range: 300 Ÿ, 3, 30, 300 kŸ, 3 and 30 MŸ
Accuracy: (0.5% rdg + 5 LSD)
Range: 30 Ÿ2
Accuracy: (2.5% rdg + 25 LSD)
Diode Test:
Range: 4 V
Accuracy: (2% rdg + 5 LSD)
Range: 1 Hz to 5 MHz
Measurement:
Accuracy: (0.5% + 2 counts)
Time Cursor
Range: Visible part of signal
(Model 97 only):
Accuracy: 0.1% 1 LSB
Voltage Cursor
Range: Visible part of signal
(Model 97 only):
Accuracy: 2% 1 pixel
Manufacturer warrants Triggering to table 1 specifications, however, during parameter check manufacturer adds an
1
additional 0.5 div to the 10, 60 and 100 MHz specifications.
Only TI's with firmware 4.01 and higher. Must be performed manually and will be performed at the end of the
2
Calibration Process in para. 22, so as not to interfere with TI calibration routine.
EQUIPMENT REQUIREMENTS
calibration procedure. This equipment is issued with Secondary Transfer Calibration
Standards Set AN/GSM-286; AN/GSM-287; or AN/GSM-705. Alternate items may be used
by the calibrating activity. The items selected must be verified to perform satisfactorily
prior to use and must bear evidence of current calibration. The equipment must meet or
provide a four-to-one ratio between the standard and TI. Where the four-to-one ratio
cannot be met, the actual accuracy of the equipment selected is shown in parentheses.
5. Accessories Required. The accessories required for this calibration are common
usage accessories, issued as indicated in paragraph 4 above, and are not listed in this
calibration procedure.
Table 2. Minimum Specifications of Equipment Required
Manufacturer and model
Common name
Minimum use specifications
(part number)
CALIBRATOR
Range: 212.13 mV to 30 V ac rms
Fluke, Model 5720A (5720A) (p/o
Accuracy: 0.25%
MIS-35947)
Range: 300 mV to 30 V dc
Accuracy: 0.125%
Range: 0 to 10 MŸ
Accuracy: 0.125%
