\[ \int x^2 \coth ^{-1}\left (\sqrt {x}\right ) \, dx \]
Optimal antiderivative \[ \frac {x^{\frac {3}{2}}}{9}+\frac {x^{\frac {5}{2}}}{15}+\frac {x^{3} \mathrm {arccoth}\left (\sqrt {x}\right )}{3}-\frac {\arctanh \left (\sqrt {x}\right )}{3}+\frac {\sqrt {x}}{3} \]
command
integrate(x^2*arccoth(x^(1/2)),x, algorithm="giac")
Giac 1.9.0-11 via sagemath 9.6 output
\[ \frac {2 \, {\left (\frac {45 \, {\left (\sqrt {x} + 1\right )}^{4}}{{\left (\sqrt {x} - 1\right )}^{4}} - \frac {90 \, {\left (\sqrt {x} + 1\right )}^{3}}{{\left (\sqrt {x} - 1\right )}^{3}} + \frac {140 \, {\left (\sqrt {x} + 1\right )}^{2}}{{\left (\sqrt {x} - 1\right )}^{2}} - \frac {70 \, {\left (\sqrt {x} + 1\right )}}{\sqrt {x} - 1} + 23\right )}}{45 \, {\left (\frac {\sqrt {x} + 1}{\sqrt {x} - 1} - 1\right )}^{5}} + \frac {2 \, {\left (\frac {3 \, {\left (\sqrt {x} + 1\right )}^{5}}{{\left (\sqrt {x} - 1\right )}^{5}} + \frac {10 \, {\left (\sqrt {x} + 1\right )}^{3}}{{\left (\sqrt {x} - 1\right )}^{3}} + \frac {3 \, {\left (\sqrt {x} + 1\right )}}{\sqrt {x} - 1}\right )} \log \left (\frac {\sqrt {x} + 1}{\sqrt {x} - 1}\right )}{3 \, {\left (\frac {\sqrt {x} + 1}{\sqrt {x} - 1} - 1\right )}^{6}} \]
Giac 1.7.0 via sagemath 9.3 output
\[ \int x^{2} \operatorname {arcoth}\left (\sqrt {x}\right )\,{d x} \]________________________________________________________________________________________