Chapter 2
Test Results

The following table summarizes perentage solved for each CAS

Table 2.1: Summary of final results
System % solved Number solved Number failed
Maple 2024.2 96.224 18731 735
Mathematica 14.2 95.597 18609 857
Sympy 1.13.3 70.502 13724 5742

The following diagram illustrates the above result graphically

Code to generate the above diagram is in this notebook

The following table summarizes the run-time performance of each CAS system.

Table 2.2: Summary of run time performance of each CAS system
System mean time (sec) mean leaf size total time (min) total leaf size
Maple 2024.2 0.318 123.93 103.283 2412348
Sympy 1.13.3 1.543 37.72 500.515 734185
Mathematica 14.2 2.921 392.41 947.727 7638600

The problem which Sympy produced largest leaf size of \(110390\) is 11799

The problem which Mathematica produced largest leaf size of \(1763961\) is 11371

The problem which Maple produced largest leaf size of \(949415\) is 14045

The problem which Sympy used most CPU time of \(179.996\) seconds is 18744

The problem which Mathematica used most CPU time of \(178.922\) seconds is 12837

The problem which Maple used most CPU time of \(36.748\) seconds is 16353