\[ \int (a+a \cos (c+d x))^{5/2} (A+B \cos (c+d x)) \sec ^5(c+d x) \, dx \]
Optimal antiderivative \[ \frac {a^{\frac {5}{2}} \left (163 A +200 B \right ) \arctanh \left (\frac {\sin \left (d x +c \right ) \sqrt {a}}{\sqrt {a +a \cos \left (d x +c \right )}}\right )}{64 d}+\frac {a A \left (a +a \cos \left (d x +c \right )\right )^{\frac {3}{2}} \left (\sec ^{3}\left (d x +c \right )\right ) \tan \left (d x +c \right )}{4 d}+\frac {a^{3} \left (163 A +200 B \right ) \tan \left (d x +c \right )}{64 d \sqrt {a +a \cos \left (d x +c \right )}}+\frac {a^{3} \left (95 A +104 B \right ) \sec \left (d x +c \right ) \tan \left (d x +c \right )}{96 d \sqrt {a +a \cos \left (d x +c \right )}}+\frac {a^{2} \left (11 A +8 B \right ) \left (\sec ^{2}\left (d x +c \right )\right ) \sqrt {a +a \cos \left (d x +c \right )}\, \tan \left (d x +c \right )}{24 d} \]
command
integrate((a+a*cos(d*x+c))^(5/2)*(A+B*cos(d*x+c))*sec(d*x+c)^5,x, algorithm="giac")
Giac 1.9.0-11 via sagemath 9.6 output
\[ -\frac {\sqrt {2} {\left (3 \, \sqrt {2} {\left (163 \, A a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) + 200 \, B a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right )\right )} \log \left (\frac {{\left | -2 \, \sqrt {2} + 4 \, \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right ) \right |}}{{\left | 2 \, \sqrt {2} + 4 \, \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right ) \right |}}\right ) + \frac {4 \, {\left (3912 \, A a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{7} + 4800 \, B a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{7} - 7172 \, A a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{5} - 8288 \, B a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{5} + 4606 \, A a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{3} + 4816 \, B a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{3} - 1047 \, A a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right ) - 936 \, B a^{2} \mathrm {sgn}\left (\cos \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right ) \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )\right )}}{{\left (2 \, \sin \left (\frac {1}{2} \, d x + \frac {1}{2} \, c\right )^{2} - 1\right )}^{4}}\right )} \sqrt {a}}{768 \, d} \]
Giac 1.7.0 via sagemath 9.3 output
\[ \text {Timed out} \]________________________________________________________________________________________