ACL RD-TEC 2.0 --- Inter Annotator Agreement Detailed Per Class Category
Computed inter annotator agreement per class category per file.
ACL ID | IAAS | IAAA | Tech | System | LR | LR-Prod | Model | Measure(ment) | Other |
---|---|---|---|---|---|---|---|---|---|
T78-1001 | 0.87 | 0.82 | 0 | 0 | 0 | 0 | 0 | 0 | 0.9 |
T78-1028 | 0.86 | 0.78 | 0 | 0 | 0 | 0 | 0 | 0 | 0.8 |
T78-1031 | 0.94 | 0.73 | 1 | 0 | 0 | 0 | 0 | 0 | 0.73 |
C80-1039 | 0.53 | 0.53 | 0 | 0 | 0 | 0 | 0 | 0 | 0.67 |
C80-1073 | 0.75 | 0.5 | 0.57 | 0 | 0 | 0 | 0.67 | 0 | 0.57 |
P80-1004 | 0.69 | 0.21 | 0 | 0 | 0 | 0 | 0 | 0 | 0.33 |
P80-1019 | 0.64 | 0.64 | 0.91 | 0 | 0 | 0 | 0 | 0 | 0.75 |
P80-1026 | 0.6 | 0.53 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0.5 |
C82-1054 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
J82-3002 | 0.88 | 0.85 | 1 | 0 | 0 | 0 | 0 | 0 | 0.8 |
P82-1035 | 0.51 | 0.51 | 1 | 0 | 0 | 0 | 0 | 0 | 0.71 |
P84-1020 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
P84-1034 | 0.93 | 0.93 | 1 | 0 | 0 | 0 | 1 | 0 | 1 |
P84-1047 | 0.8 | 0.55 | 0.75 | 0 | 0 | 0 | 0 | 0 | 0.6 |
P84-1064 | 0.89 | 0.79 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.84 |
P84-1078 | 0.83 | 0.78 | 1 | 0 | 0 | 0 | 0 | 0 | 0.88 |
C86-1081 | 0.86 | 0.86 | 0 | 0 | 0 | 0 | 0 | 0 | 0.95 |
C86-1132 | 0.88 | 0.88 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
J86-1002 | 0.74 | 0.64 | 1 | 0 | 0 | 0 | 0 | 0 | 0.4 |
J86-3001 | 0.83 | 0.82 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0.88 |
J86-4002 | 0.86 | 0.84 | 0 | 0 | 0 | 0 | 0 | 0 | 0.97 |
P86-1011 | 0.92 | 0.73 | 0 | 0 | 0 | 0 | 0 | 0 | 0.8 |
P86-1038 | 0.84 | 0.66 | 0.67 | 0 | 0 | 0 | 1 | 0 | 0.73 |
A88-1001 | 0.76 | 0.63 | 1 | 0 | 0 | 0 | 0 | 0 | 0.67 |
A88-1003 | 0.53 | 0.43 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0 |
C88-1007 | 0.59 | 0.56 | 0.4 | 0 | 0 | 0 | 0 | 0 | 0.75 |
C88-1044 | 0.71 | 0.71 | 1 | 0 | 0 | 0 | 0 | 0 | 0.86 |
C88-1066 | 0.87 | 0.69 | 1 | 0 | 0 | 0 | 0 | 0 | 0.74 |
C88-2086 | 0.57 | 0.57 | 0 | 0 | 0 | 0 | 0 | 0 | 0.8 |
C88-2130 | 1 | 0.67 | 0 | 0 | 1 | 0 | 0 | 0 | 0.4 |
C88-2132 | 0.55 | 0.48 | 1 | 0 | 0 | 0 | 0 | 0 | 0.62 |
C88-2160 | 0.43 | 0.43 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.6 |
C88-2162 | 0.83 | 0.45 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.44 |
C88-2166 | 0.7 | 0.64 | 1 | 0 | 0.91 | 0 | 0 | 0 | 0 |
J88-3002 | 0.9 | 0.86 | 0.91 | 0 | 0 | 0 | 1 | 0 | 0.86 |
C90-1013 | 0.91 | 0.67 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
C90-2032 | 0.7 | 0.7 | 0.8 | 0 | 1 | 0 | 0 | 0 | 1 |
C90-3014 | 0.67 | 0.33 | 0 | 0 | 1 | 0 | 0 | 0 | 1 |
C90-3045 | 0.71 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0 | 0.79 |
C90-3046 | 0.88 | 0.62 | 1 | 0 | 0 | 0 | 0 | 0 | 0.57 |
C90-3063 | 0.69 | 0.36 | 0 | 0 | 0.67 | 0 | 0 | 0 | 0.53 |
C90-3072 | 0.86 | 0.83 | 1 | 0 | 0.5 | 0 | 0 | 0 | 0.88 |
H90-1016 | 0.5 | 0.42 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.8 |
H90-1060 | 0.83 | 0.74 | 0.77 | 0 | 0.91 | 1 | 0 | 0.8 | 0.88 |
J90-3002 | 0.88 | 0.83 | 1 | 0 | 1 | 0 | 0 | 0 | 0.86 |
P90-1014 | 0.75 | 0.46 | 1 | 0 | 0 | 0 | 0 | 0 | 0.4 |
A92-1026 | 0.77 | 0.77 | 0.93 | 0 | 0 | 0 | 0 | 0 | 0.5 |
A92-1027 | 0.84 | 0.8 | 1 | 0 | 0 | 0 | 0 | 0 | 0.87 |
C92-1052 | 0.92 | 0.73 | 1 | 0 | 0 | 0 | 0 | 0 | 0.75 |
C92-1055 | 0.76 | 0.71 | 0.86 | 0 | 0.67 | 0 | 1 | 1 | 0.67 |
C92-2068 | 0.5 | 0.5 | 0.89 | 0 | 0 | 0 | 0 | 0 | 0.8 |
C92-2115 | 1 | 0.91 | 0.95 | 0 | 0 | 0 | 0 | 0 | 0.67 |
C92-3165 | 0.67 | 0.67 | 0.86 | 0 | 1 | 0 | 0 | 0 | 1 |
C92-4199 | 0.76 | 0.7 | 1 | 0 | 1 | 0 | 0 | 0 | 0.86 |
C92-4207 | 0.58 | 0.48 | 0 | 0 | 0 | 0 | 0 | 0 | 0.67 |
H92-1003 | 0.94 | 0.88 | 0 | 0 | 1 | 0 | 0 | 0 | 1 |
H92-1010 | 0.89 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
H92-1016 | 0.8 | 0.75 | 1 | 0 | 0.8 | 0 | 1 | 0.67 | 0 |
H92-1017 | 0.67 | 0.59 | 1 | 0 | 0 | 0 | 0 | 0.67 | 0 |
H92-1026 | 0.74 | 0.55 | 0.25 | 0 | 0.67 | 0 | 0 | 0 | 0.9 |
H92-1036 | 0.83 | 0.79 | 0.87 | 0 | 0 | 0 | 0 | 0 | 1 |
H92-1045 | 0.83 | 0.77 | 1 | 0 | 0 | 1 | 0 | 0 | 0.78 |
H92-1060 | 0.6 | 0.46 | 0 | 0 | 1 | 0 | 0 | 0 | 0.88 |
H92-1074 | 0.69 | 0.64 | 1 | 0 | 0 | 1 | 0 | 0 | 0.33 |
H92-1095 | 0.74 | 0.74 | 0.88 | 0 | 0 | 0 | 0 | 0 | 0 |
A94-1007 | 0.84 | 0.63 | 0.67 | 0 | 0 | 0 | 0 | 1 | 0.71 |
A94-1011 | 0.77 | 0.66 | 0.9 | 0 | 1 | 0 | 0 | 0 | 0.69 |
A94-1017 | 0.79 | 0.68 | 0.92 | 0 | 0 | 0 | 0 | 0 | 0.57 |
A94-1026 | 0.82 | 0.82 | 1 | 0 | 0 | 0 | 0 | 0 | 0.85 |
C94-1026 | 0.86 | 0.74 | 1 | 0 | 0 | 0 | 0 | 0 | 0.67 |
C94-1030 | 0.93 | 0.86 | 1 | 0 | 0 | 0 | 0 | 0 | 0.87 |
C94-1052 | 0.84 | 0.71 | 1 | 0 | 0 | 0 | 0 | 0 | 0.73 |
C94-1061 | 0.83 | 0.6 | 1 | 0 | 0 | 0 | 0 | 0 | 0.62 |
C94-1077 | 0.92 | 0.88 | 1 | 0 | 0 | 0 | 0 | 0 | 0.89 |
C94-1079 | 0.74 | 0.5 | 0.67 | 0 | 1 | 0 | 0 | 0 | 0.4 |
C94-1080 | 0.84 | 0.71 | 0.83 | 0 | 0 | 0 | 0.67 | 0 | 0.77 |
C94-1082 | 0.6 | 0.6 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0.67 |
C94-2151 | 0.75 | 0.75 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.75 |
H94-1014 | 0.86 | 0.81 | 0 | 0 | 0.67 | 1 | 0.8 | 1 | 1 |
H94-1034 | 0.75 | 0.7 | 1 | 0 | 0 | 0 | 0 | 0 | 0.75 |
H94-1084 | 0.76 | 0.76 | 0.92 | 0 | 0 | 0 | 0 | 0 | 1 |
H01-1001 | 0.74 | 0.43 | 1 | 0 | 0 | 0 | 1 | 0 | 0.5 |
H01-1017 | 0.62 | 0.62 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
H01-1040 | 0.83 | 0.67 | 1 | 0 | 0 | 0 | 0 | 0 | 0.67 |
H01-1041 | 0.84 | 0.82 | 0.84 | 0 | 1 | 0 | 0 | 0 | 1 |
H01-1042 | 0.95 | 0.95 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
H01-1049 | 0.9 | 0.9 | 1 | 0 | 0 | 0 | 0 | 0 | 0.83 |
H01-1055 | 1 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
H01-1058 | 0.98 | 0.88 | 1 | 0 | 0 | 0 | 1 | 1 | 0.67 |
H01-1068 | 0.67 | 0.67 | 1 | 0 | 0 | 0 | 0 | 0.8 | 0 |
H01-1070 | 1 | 1 | 1 | 0 | 0 | 0 | 1 | 1 | 0 |
N01-1003 | 0.84 | 0.82 | 1 | 0 | 1 | 0 | 1 | 0 | 0.74 |
P01-1004 | 0.91 | 0.91 | 1 | 0 | 0 | 0 | 1 | 1 | 1 |
P01-1007 | 0.78 | 0.68 | 0.91 | 0 | 1 | 0 | 0 | 0 | 0.74 |
P01-1008 | 0.95 | 0.95 | 0.89 | 0 | 1 | 0 | 0 | 0 | 1 |
P01-1009 | 0.69 | 0.64 | 0.86 | 0 | 0 | 0 | 0 | 1 | 0.91 |
P01-1047 | 0.93 | 0.93 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
P01-1056 | 0.93 | 0.93 | 1 | 0 | 0 | 0 | 0 | 1 | 1 |
P01-1070 | 0.8 | 0.67 | 0 | 0 | 0 | 0 | 1 | 1 | 0.75 |
N03-1001 | 0.94 | 0.87 | 0.91 | 0 | 1 | 0 | 1 | 1 | 0.75 |
N03-1004 | 0.76 | 0.76 | 0.94 | 0 | 1 | 0 | 0 | 0.5 | 0.86 |
N03-1012 | 0.96 | 0.92 | 0 | 0 | 1 | 0 | 0 | 1 | 0.93 |
N03-1017 | 1 | 1 | 1 | 0 | 1 | 0 | 1 | 0 | 1 |
N03-1018 | 0.78 | 0.71 | 0.73 | 0 | 1 | 0 | 0.86 | 1 | 0.75 |
N03-1026 | 0.76 | 0.63 | 0.94 | 0 | 0 | 0 | 1 | 0 | 0.6 |
N03-1033 | 0.88 | 0.73 | 1 | 0 | 0 | 0 | 1 | 0.67 | 0.8 |
N03-2003 | 0.92 | 0.92 | 0.8 | 0 | 1 | 0 | 0 | 0 | 1 |
N03-2006 | 0.67 | 0.61 | 1 | 0 | 0 | 0 | 1 | 1 | 0 |
N03-2015 | 0.97 | 0.97 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
N03-2017 | 1 | 0.73 | 1 | 0 | 0 | 0 | 0 | 1 | 0.57 |
N03-2025 | 0.84 | 0.78 | 1 | 0 | 1 | 0 | 0.5 | 0 | 0.89 |
N03-2036 | 0.88 | 0.85 | 1 | 0 | 0 | 0 | 1 | 0 | 0.8 |
N03-3010 | 0.95 | 0.95 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
N03-4004 | 0.67 | 0.67 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
N03-4010 | 1 | 1 | 1 | 0 | 1 | 0 | 0 | 0 | 1 |
P03-1002 | 0.88 | 0.71 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0.8 |
P03-1005 | 1 | 0.89 | 1 | 0 | 0 | 0 | 0 | 1 | 0.73 |
P03-1009 | 0.64 | 0.64 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.83 |
P03-1022 | 0.95 | 0.95 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
P03-1030 | 1 | 0.95 | 1 | 0 | 1 | 0 | 0 | 1 | 0 |
P03-1031 | 0.83 | 0.76 | 0.67 | 0 | 1 | 0 | 0 | 1 | 0.84 |
P03-1033 | 0.86 | 0.86 | 1 | 0 | 1 | 0 | 1 | 1 | 0.89 |
P03-1050 | 0.96 | 0.96 | 1 | 0 | 0.91 | 0 | 1 | 1 | 1 |
P03-1051 | 0.74 | 0.72 | 1 | 0 | 0.44 | 0 | 1 | 0.67 | 0.96 |
P03-1058 | 0.81 | 0.81 | 1 | 0 | 0.89 | 0 | 0 | 0 | 1 |
P03-1068 | 0.8 | 0.8 | 0.8 | 0 | 1 | 0 | 0 | 0 | 0.91 |
P03-1070 | 0.97 | 0.97 | 1 | 0 | 0 | 0 | 0 | 0 | 1 |
P03-2036 | 1 | 0.91 | 1 | 0 | 0 | 0 | 0 | 0 | 0.89 |
H05-1005 | 0.62 | 0.57 | 1 | 0 | 0 | 0 | 0 | 0 | 0.92 |
H05-1012 | 0.83 | 0.83 | 0.89 | 0 | 1 | 0 | 1 | 1 | 1 |
H05-1095 | 0.96 | 0.92 | 0.75 | 0 | 1 | 0 | 0 | 1 | 1 |
H05-1101 | 0.75 | 0.57 | 0 | 0 | 0 | 0 | 1 | 0 | 0.5 |
H05-1117 | 0.67 | 0.67 | 0.86 | 0 | 0 | 0 | 0 | 1 | 0.57 |
H05-2007 | 0.67 | 0.57 | 0.8 | 0 | 0 | 0 | 0 | 0 | 1 |
I05-2014 | 0.73 | 0.73 | 1 | 0 | 0 | 0 | 0 | 1 | 0.8 |
I05-2021 | 0.77 | 0.43 | 0.31 | 0 | 0 | 0 | 1 | 0.57 | 0.86 |
I05-2048 | 0.95 | 0.79 | 1 | 0 | 0 | 0 | 0 | 0 | 0.57 |
I05-4010 | 0.53 | 0.53 | 0 | 0 | 1 | 0 | 0 | 0 | 0.67 |
I05-5003 | 0.68 | 0.57 | 0.89 | 0 | 0 | 0 | 0 | 0.22 | 0.91 |
I05-5008 | 0.7 | 0.59 | 0 | 0 | 0 | 0 | 0 | 0.75 | 0.78 |
I05-6011 | 0.87 | 0.87 | 0 | 0 | 0 | 0 | 0 | 0 | 1 |
J05-1003 | 0.78 | 0.66 | 0.69 | 0 | 0 | 0 | 0.67 | 0.67 | 0.86 |
J05-4003 | 0.67 | 0.62 | 1 | 0 | 0.75 | 0 | 0 | 0 | 0.67 |
P05-1032 | 0.85 | 0.64 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0.86 |
P05-1034 | 0.95 | 0.89 | 0.92 | 0 | 1 | 0 | 1 | 0 | 0.86 |
P05-1048 | 0.86 | 0.67 | 0.75 | 0 | 0 | 0 | 0 | 0.67 | 1 |
P05-1067 | 0.93 | 0.58 | 0.71 | 0 | 1 | 0 | 0 | 0.5 | 0.4 |
P05-1069 | 0.85 | 0.64 | 0.86 | 0 | 0 | 0 | 1 | 0 | 0.5 |
P05-1074 | 0.91 | 0.77 | 1 | 0 | 1 | 0 | 0 | 0 | 0.75 |
P05-2016 | 0.82 | 0.67 | 1 | 0 | 1 | 0 | 0 | 0 | 1 |
P05-3025 | 0.42 | 0.42 | 0.89 | 0 | 0 | 0 | 0 | 0 | 0 |
E06-1004 | 0.89 | 0.85 | 1 | 0 | 0 | 0 | 1 | 0 | 1 |
E06-1018 | 0.69 | 0.69 | 0.83 | 0 | 1 | 0 | 0 | 0 | 0.8 |
E06-1022 | 0.62 | 0.62 | 0.86 | 0 | 0 | 0 | 0 | 0 | 0.88 |
E06-1031 | 0.87 | 0.71 | 0.5 | 0 | 0 | 0 | 0 | 1 | 0.62 |
E06-1035 | 0.73 | 0.73 | 1 | 0 | 0 | 0 | 0 | 0 | 0.84 |
E06-1041 | 0.75 | 0.67 | 0.8 | 0 | 0 | 0 | 0 | 0 | 0.67 |
N06-2009 | 0.67 | 0.67 | 1 | 0 | 0 | 0 | 0 | 1 | 0.8 |
N06-2038 | 0.88 | 0.88 | 0.86 | 0 | 0 | 0 | 0 | 0 | 1 |
N06-4001 | 0.42 | 0.42 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0.5 |
P06-1013 | 0.67 | 0.67 | 1 | 0 | 0 | 0 | 0 | 0 | 0.5 |
P06-1018 | 0.87 | 0.87 | 0 | 0 | 0 | 0 | 0 | 0 | 0.96 |
P06-1052 | 0.87 | 0.56 | 0 | 0 | 1 | 0 | 0 | 0 | 0.53 |
P06-2001 | 0.93 | 0.93 | 1 | 0 | 1 | 0 | 0 | 1 | 1 |
P06-2012 | 0.86 | 0.86 | 1 | 0 | 0 | 1 | 0 | 0 | 0.88 |
P06-2059 | 0.71 | 0.62 | 0 | 0 | 1 | 0 | 0 | 0 | 0.67 |
P06-2110 | 0.92 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0 | 0.74 |
P06-3007 | 0.56 | 0.47 | 0.4 | 0 | 0 | 0 | 0 | 0 | 0.75 |
P06-4007 | 0.86 | 0.86 | 0.86 | 0 | 0 | 0 | 0 | 0 | 1 |
P06-4011 | 0.77 | 0.73 | 0.67 | 0 | 0 | 0 | 1 | 0 | 0.84 |
P06-4014 | 0.77 | 0.55 | 0.67 | 0 | 0 | 0 | 0 | 0 | 0 |