\[ \int \sec ^{\frac {3}{2}}(c+d x) (a+a \sec (c+d x))^3 (A+B \sec (c+d x)) \, dx \]
Optimal antiderivative \[ \frac {4 a^{3} \left (13 A +11 B \right ) \left (\sec ^{\frac {3}{2}}\left (d x +c \right )\right ) \sin \left (d x +c \right )}{21 d}+\frac {4 a^{3} \left (24 A +23 B \right ) \left (\sec ^{\frac {5}{2}}\left (d x +c \right )\right ) \sin \left (d x +c \right )}{105 d}+\frac {2 a B \left (\sec ^{\frac {5}{2}}\left (d x +c \right )\right ) \left (a +a \sec \left (d x +c \right )\right )^{2} \sin \left (d x +c \right )}{9 d}+\frac {2 \left (9 A +13 B \right ) \left (\sec ^{\frac {5}{2}}\left (d x +c \right )\right ) \left (a^{3}+a^{3} \sec \left (d x +c \right )\right ) \sin \left (d x +c \right )}{63 d}+\frac {4 a^{3} \left (21 A +17 B \right ) \sin \left (d x +c \right ) \left (\sqrt {\sec }\left (d x +c \right )\right )}{15 d}-\frac {4 a^{3} \left (21 A +17 B \right ) \sqrt {\frac {\cos \left (d x +c \right )}{2}+\frac {1}{2}}\, \EllipticE \left (\sin \left (\frac {d x}{2}+\frac {c}{2}\right ), \sqrt {2}\right ) \left (\sqrt {\cos }\left (d x +c \right )\right ) \left (\sqrt {\sec }\left (d x +c \right )\right )}{15 \cos \left (\frac {d x}{2}+\frac {c}{2}\right ) d}+\frac {4 a^{3} \left (13 A +11 B \right ) \sqrt {\frac {\cos \left (d x +c \right )}{2}+\frac {1}{2}}\, \EllipticF \left (\sin \left (\frac {d x}{2}+\frac {c}{2}\right ), \sqrt {2}\right ) \left (\sqrt {\cos }\left (d x +c \right )\right ) \left (\sqrt {\sec }\left (d x +c \right )\right )}{21 \cos \left (\frac {d x}{2}+\frac {c}{2}\right ) d} \]
command
integrate(sec(d*x+c)^(3/2)*(a+a*sec(d*x+c))^3*(A+B*sec(d*x+c)),x, algorithm="fricas")
Fricas 1.3.8 (sbcl 2.2.11.debian) via sagemath 9.6 output
\[ -\frac {2 \, {\left (15 i \, \sqrt {2} {\left (13 \, A + 11 \, B\right )} a^{3} \cos \left (d x + c\right )^{4} {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) + i \, \sin \left (d x + c\right )\right ) - 15 i \, \sqrt {2} {\left (13 \, A + 11 \, B\right )} a^{3} \cos \left (d x + c\right )^{4} {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) - i \, \sin \left (d x + c\right )\right ) + 21 i \, \sqrt {2} {\left (21 \, A + 17 \, B\right )} a^{3} \cos \left (d x + c\right )^{4} {\rm weierstrassZeta}\left (-4, 0, {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) + i \, \sin \left (d x + c\right )\right )\right ) - 21 i \, \sqrt {2} {\left (21 \, A + 17 \, B\right )} a^{3} \cos \left (d x + c\right )^{4} {\rm weierstrassZeta}\left (-4, 0, {\rm weierstrassPInverse}\left (-4, 0, \cos \left (d x + c\right ) - i \, \sin \left (d x + c\right )\right )\right ) - \frac {{\left (42 \, {\left (21 \, A + 17 \, B\right )} a^{3} \cos \left (d x + c\right )^{4} + 30 \, {\left (13 \, A + 11 \, B\right )} a^{3} \cos \left (d x + c\right )^{3} + 7 \, {\left (27 \, A + 34 \, B\right )} a^{3} \cos \left (d x + c\right )^{2} + 45 \, {\left (A + 3 \, B\right )} a^{3} \cos \left (d x + c\right ) + 35 \, B a^{3}\right )} \sin \left (d x + c\right )}{\sqrt {\cos \left (d x + c\right )}}\right )}}{315 \, d \cos \left (d x + c\right )^{4}} \]
Fricas 1.3.7 via sagemath 9.3 output
\[ {\rm integral}\left ({\left (B a^{3} \sec \left (d x + c\right )^{5} + {\left (A + 3 \, B\right )} a^{3} \sec \left (d x + c\right )^{4} + 3 \, {\left (A + B\right )} a^{3} \sec \left (d x + c\right )^{3} + {\left (3 \, A + B\right )} a^{3} \sec \left (d x + c\right )^{2} + A a^{3} \sec \left (d x + c\right )\right )} \sqrt {\sec \left (d x + c\right )}, x\right ) \]