TB 9-6625-011-24
Table 3. Range Accuracy
Test instrument
Calibrator
RANGE
ERROR display
switch settings
indications
(VOLTS)
Meter indication scale
Initial output
< (%)
0-to-1
0-to-3
Voltage
Frequency
(Hz)
1.01
.001
1
---
1.0
V
400
.003
---
3
3.0
V
400
1.0
Reset calibrator and remove ac divider from setup.
.03
---
3
30
mV
400
1.0
.1
1
---
100
mV
400
1.0
1.02
.3
---
3
0.3
V
400
1.03
1
1
---
1.0
V
400
1
.8
---
0.8
V
400
1.25
1
.6
---
0.6
V
400
1.7
1
.4
---
0.4
V
400
2.5
1
.2
---
200
mV
400
5.0
3
---
3
3.0
V
400
1.0
10
1
---
10
V
400
1.0
30
---
3
30
V
400
1.0
100
1
---
100
V
400
1.0
300
---
3
300
V
400
1.0
Record this value for use in table 4 as ERRref1 (include the sign).
1
Record this value for use in table 4 as ERRref2 (include the sign).
2
(8) Connect TI INPUT to calibrator WIDEBAND output and press calibrator
WBND pushbutton.
(9) Set TI RANGE switch to .001 VOLTS.
(10) Set calibrator output for an initial 0.001V @ 400 Hz. Adjust the calibrator
output amplitude for precisely `1' on the TI meter. Press calibrator NEW REF pushbutton.
(11) Set calibrator frequency to 20 Hz, then readjust the calibrator output amplitude
for precisely `1' on the TI meter. Record calibrator Error display indication as ERRmeas1
(include the sign). Algebraically calculate TI frequency response error using the formula
below. The TI error will be < 5.0 percent.
TI frequency response error = ERRmeas1 + ERRref1
Example:
ERRmeas1 = -2.3%
ERRref1 = 0.4%
-2.3+0.4=-1.9%
(12) Repeat technique of (11) above for remaining frequencies listed for the .001
specified limits; if not, perform b (9) through (11) below.
(13) Repeat technique of (9) through (12) above for TI 1 VOLTS RANGE switch
formula. TI frequency response error will be within the limits specified; if not, perform b
(12) through (14).
CHANGE 1 5
