TB 9-6625-2263-35
Table 1. Calibration Description - Continued
Accuracy
(% of input
Range
Full-scale
+ digits)
Ω
10
19.9999
0.0140 + 12
Ω
100
199.999
0.0125 + 3
Ω
1000
1999.99
0.0125 + 3
kΩ
10
19.9999
0.0125 + 3
kΩ
100
199.999
0.0140 + 3
MΩ
1
1.99999
0.0200 + 3
MΩ
10
19.999
0.0450 + 3
Range: 100 nS
Full scale: 202.00 nS
(0.06% of input + 5 digits)
Accuracy:
1From
0.1% of range to FS. For 650 V range multiply % of FS by 1.6. Maximum Volts-Hertz product is 2 X 107.
EQUIPMENT REQUIREMENTS
4. Equipment
Required. Table 2 identifies the
specific equipment to be
used in this
calibration procedure. This equipment is issued with Secondary Transfer Calibration
Standards Set AN/GSM-286. Alternate items may be used by the calibrating activity.
The items selected must be verified to perform satisfactorily prior to use and must bear
evidence of current calibration. The equipment must meet or exceed the minimum use
specifications listed in table 2. The accuracies listed in table 2 provide a four-to-one
ratio between the standard and TI.
5. Accessories Required. The
accessories required for the
calibration are
common
usage accessories, issued as indicated in paragraph 4 above, and are not listed in this
calibration procedure.
Table 2. Minimum Specifications of
Equipment Required
Minimum use
Manufacturer and model
Common name
specifications
(part number)
CALIBRATOR
Dc voltage:
John Fluke, Model 5720A (p.o
Range: -8.1 to +1000 V
MIS-35947), w/power amplifier,
Accuracy: 0.0025%
John Fluke, Model 5725A
(5725A)
Accuracy (%)
Range
0Ω
300 Ω
10Ω
0.006
100Ω, 1 kΩ, 10 kΩ
0.004
100 kΩ
0.004
1 MΩ
0.006
10 M Ω
0.019