TB 9-6625-2246-40
Table 1. Calibration Description Continued
Test instrument
parameters
Performance specifications
13 +
0.6
Resistance (continued)
100 k
18 +
3
1M
53 + 11
10 M
503 + 18
100 M
5003 + 82
1G
Dc current
Range: 0 to 1 A (in 8 ranges)
Accuracy: (ppm of reading + ppm of range)
Range3
Accuracy
A
25 +
8.6
100
1
mA
25 +
5.6
10
mA
25 +
5.6
100
mA
41 +
5.6
1
A
115 + 10.6
Range: 1 Hz to 10 MHz
0.05% of reading
Accuracy: 1 to 40 Hz
40 Hz to 10 MHz
0.01% of reading
Ac voltage4
Range: 0 to 700 V rms (in 6 ranges)
Accuracy: (% of reading +% of range)
Frequencies
Range
10 mV
100 mV to 10 V
100 V
1000 V
10 to 20 Hz
0.4 + 0.32
0.4 + 0.02
0.4 + 0.02
0.42 + 0.03
20 to 40 Hz
0.15 + 0.25
0.15 + 0.02
0.15 + 0.02
0.17 + 0.03
40 to 100 Hz
0.06 + 0.25
0.06 + 0.01
0.06 + 0.01
0.08 + 0.02
100 Hz to 20 kHz
0.02 + 0.25
0.02 + 0.01
0.03 + 0.01
0.06 + 0.02
20 to 50 kHz
0.15 + 0.25
0.15 + 0.04
0.15 + 0.04
0.15 + 0.04
50 to 100 kHz
0.7 + 0.35
0.6 + 0.08
0.5 + 0.08
0.6
+ 0.2
100 to 250 kHz
4.0 + 0.7
2.0 + 0.5
2.0 + 0.5
---
250 to 500 kHz
---
3.0 + 0.6
3.0 + 0.6
---
500 kHz to 1 MHz
---
5.0 + 2.0
5.0 + 2.0
---
1 to 2 MHz
---
10.0 + 5.0
---
---
3