2.11 Independent_test_suites\WelzProblems

Table 13: Breakdown of results for each integral


















































2017.3
2016.2
2015.2
18.02
17.02
16.02
14.0
12.0

























# grade cpu size grade cpu size grade cpu size grade cpu size grade cpu size grade cpu size grade cpu size grade cpu siz

























1 A 0. 14 A 0. 14 A 0. 14 A 0. 14 A 0. 14 A 0.02 14 A 0. 14 A 0. 14

























2 C 0. 34 C 0. 34 C 0. 34 C 0. 34 C 0. 34 C 0. 34 C 0. 37 C 0. 37

























3 B 0.06 370 B 0.05 360 B 0.05 360 B 0.04 360 B 0.05 360 B 0.05 360 B 0.03 360 B 0.03 360

























4 B 0.06 172 B 0.05 172 B 0.05 172 B 0.05 172 B 0.05 172 B 0.05 172 B 0.04 172 B 0.06 172

























5 B 0.02 115 B 0.02 115 B 0.02 115 B 0.02 115 B 0.02 115 B 0.02 115 B 0.01 115 B 0.02 115

























6 B 0.03 125 B 0.03 125 B 0.03 125 B 0.03 125 B 0.03 125 B 0.03 125 B 0.03 125 B 0.05 125

























7 A 0.02 45 A 0.02 46 A 0.02 46 A 0.02 46 A 0.03 46 A 0.01 46 A 0.02 46 A 0.02 46

























8 A 0. 21 A 0.01 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21

























9 B 0.16 902 B 0.13 1072 B 0.12 1072 B 0.13 1072 B 0.11 1072 B 0.11 1072 B 0.07 1072 B 0.12 1068

























10 B 0.03 1542 B 0.04 1712 B 0.04 1712 B 0.03 1712 B 0.03 1712 B 0.06 1712 B 0.02 1712 B 0.05 1708

























11 B 0.02 278 B 0.02 278 B 0.02 278 B 0.02 278 B 0.02 278 B 0.02 278 B 0.01 278 B 0.02 278

























12 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























13 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























14 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























15 C 0.05 22 C 0.05 22 C 0.04 22 C 0.04 22 C 0.03 22 C 0.03 22 C 0.03 22 C 0.05 22

























16 A 0. 16 A 0. 16 A 0. 16 A 0. 16 A 0.02 16 A 0. 16 A 0. 16 A 0.02 16

























17 B 0.04 120 B 0.03 120 B 0.09 124 B 0.04 124 B 0.01 124 B 0.03 124 B 0.04 124 B 0.02 124

























18 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























19 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























20 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























21 A 0.02 48 A 0.02 48 A 0.02 48 A 0.02 48 A 0.02 48 A 0.02 48 A 0.01 48 A 0.02 48

























22 A 0. 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21 A 0. 21

























23 A 0.02 51 A 0.02 51 A 0.02 51 A 0.02 51 A 0.01 51 A 0.02 51 A 0.01 51 A 0.05 51

























24 B 0.06 455 B 0.06 455 B 0.05 454 B 0.05 454 B 0.05 455 B 0.05 455 B 0.04 455 B 0.05 454

























25 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























26 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























27 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























28 C 0.01 25 C 0.01 25 C 0. 25 C 0.03 25 C 0. 25 C 0.02 25 C 0.01 25 C 0. 25

























29 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























30 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























31 B 0.03 120 B 0.03 120 B 0.03 124 B 0.03 124 B 0.02 124 B 0.03 124 B 0.02 124 B 0.02 124

























32 A 0.08 44 A 0.07 44 A 0.06 44 A 0.07 44 A 0.06 44 A 0.08 44 A 0.06 44 A 0.11 44

























33 C 0.07 65 C 0.06 65 C 0.04 65 C 0.04 65 C 0.05 65 C 0.05 65 C 0.03 65 C 0.05 65

























34 C 0.06 48 C 0.06 48 C 0.05 48 C 0.04 48 C 0.04 48 C 0.05 48 C 0.03 48 C 0.05 48

























35 C 0.03 12 C 0.03 12 C 0.02 12 C 0.02 12 C 0.02 12 C 0.02 12 C 0.02 12 C 0.03 12

























36 C 0.06 65 C 0.05 65 C 0.04 65 C 0.04 65 C 0.04 65 C 0.05 65 C 0.03 65 C 0.05 65

























37 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























38 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























39 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























40 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























41 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























42 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























43 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























44 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























45 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























46 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























47 A 0.14 584 C 0.86 3218 C 0.77 3218 C 0.74 3218 C 0.72 3218 C 0.8 3218 C 0.36 3218 C 0.64 3207

























48 A 0.09 719 C 0.79 4213 C 0.73 4213 C 0.71 4213 C 0.67 4213 C 0.75 4213 C 0.34 4213 C 0.66 4202

























49 A 0.15 989 C 1.14 7553 C 1.07 7553 C 1.04 7553 C 0.97 7553 C 1.06 7553 C 0.57 7553 C 2.03 7770

























50 B 0.91 21028 B 0.87 20011 B 0.87 20011 B 0.86 20011 B 0.82 20011 B 0.95 20011 B 0.62 20011 B 1.4 20011

























51 B 6.88 86793 B 9.98 80921 B 9.64 80921 B 8.58 80921 B 8.94 80921 B 13.92 80921 B 13.12 80921 B 53.35 80921

























52 C 0.17 1275 C 0.15 1275 C 0.16 1907 C 0.1 1907 C 0.11 1907 C 0.12 1907 C 0.1 1907 C 0.11 1907

























53 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























54 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























55 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























56 C 0.07 69 C 0.07 69 C 0.06 69 C 0.05 69 C 0.05 69 C 0.05 69 C 0.04 69 C 0.05 69

























57 C 0.07 49 C 0.06 49 C 0.05 49 C 0.05 49 C 0.04 49 C 0.05 49 C 0.03 49 C 0.05 49

























58 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























59 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























60 A 0. 24 A 0. 24 A 0. 24 A 0. 24 A 0. 24 A 0. 24 A 0. 24 A 0. 24

























61 A 0.04 52 A 0.04 52 A 0.04 52 A 0.04 52 A 0.04 52 A 0.03 52 A 0.03 52 A 0.03 52

























62 A 0.04 75 A 0.04 75 A 0.03 73 A 0.03 73 A 0.03 73 A 0.03 73 A 0.02 73 A 0.03 73

























63 B 0.02 100 B 0.02 100 B 0.02 100 B 0.02 100 B 0.02 100 B 0.02 100 B 0.02 100 B 0.03 100

























64 C 0.04 365 C 0.04 365 C 0.04 365 C 0.03 365 C 0.04 365 C 0.05 365 C 0.02 415 C 0.05 415

























65 C 0.1 1421 C 0.09 1421 C 0.07 1421 C 0.07 1421 C 0.06 1421 C 0.08 1421 C 0.05 1421 C 0.09 1421

























66 B 0.13 456 B 0.14 456 B 0.12 456 B 0.13 452 B 0.11 456 B 0.16 456 B 0.18 452 B 0.11 456

























67 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























68 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























69 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0

























70 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0 F 0 0