Ali Almustanyir, Reema Alduhayan, Mosaad Alhassan, Kholoud Bokhary, and Balsam Alabdulkader, "Evaluation of the Waggoner computerized D15 color vision test using an iPad device," J. Opt. Soc. Am. A 38, 1647-1655 (2021)
The W-D15 test, a computerized variant of the F-D15 test, is used to determine whether an individual with a color vision defect can safely perform color-related tasks. This study evaluated the performance of the W-D15 test using an iPad. Fifty-nine color normal and 61 color vision defect subjects participated. Participants were screened based on the Ishihara, City University Test, and Waggoner PIP24 tests. Different failure criteria of the D15 tests were considered. The pass/failure agreement between the two tests was relatively appropriate, with a ${\kappa}$-coefficient ${\ge} {0.8}$, for all failure criteria. The W-D15 could be an appropriate substitute for F-D15 using an iPad.
Data underlying the results presented in this paper are contained within the paper.
Cited By
You do not have subscription access to this journal. Cited by links are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.
You do not have subscription access to this journal. Figure files are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.
You do not have subscription access to this journal. Article tables are available to subscribers only. You may subscribe either as an Optica member, or as an authorized user of your institution.
Farnsworth’s criterion [9] major crossing Birch’s criterion [2] No error was allowed C-index [22–24]
Visual inspection: comparing error pattern to score sheet. Color difference vector angle size [22–24] Deutan Protan Scotopic Tritan
Table 2.
Summary of Median, Minimum, Maximum, Mean, and Standard Deviation (SD) Values for All CVD Subjects for Each Brightness Mode Using the C-Index Results
Median
Minimum
Maximum
Mean
SD
Recommended brightness ()
3.39
1.00
4.52
2.82
1.28
High brightness ()
3.56
1.00
4.85
2.85
1.37
Table 3.
Numbers and Percentages of Pass/Failure Participants Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index , and Chi-Square Test () Valuesa
F-D15 Normal Conditions
W-D15 Recommended Brightness Mode
W-D15 High Brightness Mode
Criterion
Number
%
Number
%
Number
%
Chi-Square ()
P-Value
Farnsworth’s criterion ()
Pass
17 (13D and 4P)
28
17 (13D and 4P)
28
18 (15D and 3P)
29.5
0.036
0.85
Fail
44
72
44
72
43
70.5
Birch’s criterion ()
Pass
15 (13D and 2P)
25
14 (12D and 2P)
23
17 (14D and 3P)
28
0.34
0.56
Fail
46
75
47
77
44
72
C-index criterion ()
Pass
18 (15D and 3P)
29.5
17 (13D and 4P)
28
19 (16D and 3P)
31
0.14
0.71
Fail
43
70.5
44
72
42
69
P denotes protan, and D denotes deutan.
Table 4.
Pass/Failure Agreement between W-D15 and F-D15 in the First Visit Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index a
F-D15
Recommended Brightness
High Brightness
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Pass
Fail
Pass
Fail
Pass
Fail
Pass
Fail
Pass
Fail
Pass
Fail
W-D15
Pass
15
2 (P and D)
13
1 (D)
16
1 (P)
15
3 (3 D)
14
3 (2 D and 1P)
16
3 (3 D)
Fail
2 (P and D)
42
2 (2 D)
45
2 (P and D)
42
2 (P and D)
41
1 (D)
43
2 (P and D)
40
P denotes protan, and D denotes deutan.
Table 5.
Kappa Coefficient of the Pass/Failure and Classification Agreement Values (95% CI) between F-D15 and W-D15 Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index Failure Criteria
Failure Criterion
Farnsworth’s Criterion
Birch’s Criterion
C-Index Criterion
Pass/failure recommended brightness
0.84 (0.68–0.99)
0.86 (0.71–1.00)
0.88 (0.75–1.00)
Pass/failure high brightness
0.80 (0.63–0.97)
0.83 (0.67–0.99)
0.80 (0.64–0.97)
Classification recommended brightness
0.59 (0.36–0.82)
0.57 (0.35–0.80)
0.88 (0.74–1.00)
Classification high brightness
0.65 (0.44–0.86)
0.60 (0.39–0.81)
0.84 (0.68–0.99)
Table 6.
ROC Analyses and Agreement Results between W-D15 and F-D15 Testsa
Values in parentheses are 95% confidence intervals.
Sensitivity: proportion of CVDs who failed both tests.
Specificity: proportion of CVDs who passed both tests.
Table 7.
W-D15 Classification Agreement with F-D15 at Each Pass/Failure Criterion for Both Monitor-Brightness Modes Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index Failure Criteriaa
F-D15
Recommended Brightness
High Brightness
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
W-D15
Deutan
16
7(5D and 2P)
0
16
7(5D and 2P)
0
22
1(1P)
0
16
7(5D and 2P)
0
16
7(5D and 2P)
0
21
1(1P)
0
Protan
2(1D and 1P)
16
1(1D)
2(1D and 1P)
17
2(1D and 1P)
1(1P)
15
0
1(1P)
16
0
1(1P)
16
1(1P)
1(1P)
15
0
Mixed
0
0
2
0
0
2
0
1(1P)
3
1(1D)
0
3
1(1D)
1(1P)
3
1(1D)
1(1P)
3
P is protan, and D is deutan based on Ishihara.
Table 8.
Proportion of Subjects Who Passed W-D15 Using Different Criteria at Two Sessions along with -Score Test Results
Brightness
Recommended Brightness
High Brightness
Criterion
Farnsworth’s Criterion ( Crossing)
Birch’s Criterion ( Crossings)
C-Index ()
Farnsworth’s Criterion ( Crossing)
Birch’s Criterion ( Crossings)
C-Index ()
Visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
Number of pass subjects
6
5
5
4
7
5
6
7
6
5
6
7
Number of fail subjects
18
19
19
20
17
19
18
17
18
19
18
17
-test and -value
,
,
,
,
,
,
Table 9.
Repeatability of W-D15 Classification Based on Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index Failure Criteria with Different Brightness Modes
W-D15 (first visit)
Recommended Brightness
High Brightness
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
W-D15
Deutan
8
1
0
8
2
0
8
0
0
7
0
0
7
0
0
8
0
0
(second
Protan
0
8
0
0
8
0
0
9
1
1
10
0
1
10
0
0
8
0
visit)
Mixed
0
0
0
0
1
0
0
0
0
0
0
0
0
0
0
0
1
1
coefficient
Tables (9)
Table 1.
Scoring Criteria for F-D15 and W-D15
Test
Failure Criteria
Classification Criterion for Red-Green Defects
F-D15 and W-D15
Farnsworth’s criterion [9] major crossing Birch’s criterion [2] No error was allowed C-index [22–24]
Visual inspection: comparing error pattern to score sheet. Color difference vector angle size [22–24] Deutan Protan Scotopic Tritan
Table 2.
Summary of Median, Minimum, Maximum, Mean, and Standard Deviation (SD) Values for All CVD Subjects for Each Brightness Mode Using the C-Index Results
Median
Minimum
Maximum
Mean
SD
Recommended brightness ()
3.39
1.00
4.52
2.82
1.28
High brightness ()
3.56
1.00
4.85
2.85
1.37
Table 3.
Numbers and Percentages of Pass/Failure Participants Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index , and Chi-Square Test () Valuesa
F-D15 Normal Conditions
W-D15 Recommended Brightness Mode
W-D15 High Brightness Mode
Criterion
Number
%
Number
%
Number
%
Chi-Square ()
P-Value
Farnsworth’s criterion ()
Pass
17 (13D and 4P)
28
17 (13D and 4P)
28
18 (15D and 3P)
29.5
0.036
0.85
Fail
44
72
44
72
43
70.5
Birch’s criterion ()
Pass
15 (13D and 2P)
25
14 (12D and 2P)
23
17 (14D and 3P)
28
0.34
0.56
Fail
46
75
47
77
44
72
C-index criterion ()
Pass
18 (15D and 3P)
29.5
17 (13D and 4P)
28
19 (16D and 3P)
31
0.14
0.71
Fail
43
70.5
44
72
42
69
P denotes protan, and D denotes deutan.
Table 4.
Pass/Failure Agreement between W-D15 and F-D15 in the First Visit Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index a
F-D15
Recommended Brightness
High Brightness
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Pass
Fail
Pass
Fail
Pass
Fail
Pass
Fail
Pass
Fail
Pass
Fail
W-D15
Pass
15
2 (P and D)
13
1 (D)
16
1 (P)
15
3 (3 D)
14
3 (2 D and 1P)
16
3 (3 D)
Fail
2 (P and D)
42
2 (2 D)
45
2 (P and D)
42
2 (P and D)
41
1 (D)
43
2 (P and D)
40
P denotes protan, and D denotes deutan.
Table 5.
Kappa Coefficient of the Pass/Failure and Classification Agreement Values (95% CI) between F-D15 and W-D15 Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index Failure Criteria
Failure Criterion
Farnsworth’s Criterion
Birch’s Criterion
C-Index Criterion
Pass/failure recommended brightness
0.84 (0.68–0.99)
0.86 (0.71–1.00)
0.88 (0.75–1.00)
Pass/failure high brightness
0.80 (0.63–0.97)
0.83 (0.67–0.99)
0.80 (0.64–0.97)
Classification recommended brightness
0.59 (0.36–0.82)
0.57 (0.35–0.80)
0.88 (0.74–1.00)
Classification high brightness
0.65 (0.44–0.86)
0.60 (0.39–0.81)
0.84 (0.68–0.99)
Table 6.
ROC Analyses and Agreement Results between W-D15 and F-D15 Testsa
Values in parentheses are 95% confidence intervals.
Sensitivity: proportion of CVDs who failed both tests.
Specificity: proportion of CVDs who passed both tests.
Table 7.
W-D15 Classification Agreement with F-D15 at Each Pass/Failure Criterion for Both Monitor-Brightness Modes Using Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index Failure Criteriaa
F-D15
Recommended Brightness
High Brightness
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Farnsworth’s Criterion
Birch’s Criterion
C-Index
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
Deutan
Protan
Mixed
W-D15
Deutan
16
7(5D and 2P)
0
16
7(5D and 2P)
0
22
1(1P)
0
16
7(5D and 2P)
0
16
7(5D and 2P)
0
21
1(1P)
0
Protan
2(1D and 1P)
16
1(1D)
2(1D and 1P)
17
2(1D and 1P)
1(1P)
15
0
1(1P)
16
0
1(1P)
16
1(1P)
1(1P)
15
0
Mixed
0
0
2
0
0
2
0
1(1P)
3
1(1D)
0
3
1(1D)
1(1P)
3
1(1D)
1(1P)
3
P is protan, and D is deutan based on Ishihara.
Table 8.
Proportion of Subjects Who Passed W-D15 Using Different Criteria at Two Sessions along with -Score Test Results
Brightness
Recommended Brightness
High Brightness
Criterion
Farnsworth’s Criterion ( Crossing)
Birch’s Criterion ( Crossings)
C-Index ()
Farnsworth’s Criterion ( Crossing)
Birch’s Criterion ( Crossings)
C-Index ()
Visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
1st visit
2nd visit
Number of pass subjects
6
5
5
4
7
5
6
7
6
5
6
7
Number of fail subjects
18
19
19
20
17
19
18
17
18
19
18
17
-test and -value
,
,
,
,
,
,
Table 9.
Repeatability of W-D15 Classification Based on Crossing (Farnsworth’s Criterion), Crossings (Birch’s Criterion), and C-Index Failure Criteria with Different Brightness Modes