Probing the CP Structure of the Top Quark Yukawa at the Future Muon Collider

Abstract

We study the top-Higgs coupling with a CP violating phase $\xi$ at a future multi-TeV muon collider. We focus on processes that are directly sensitive to the top quark Yukawa coupling: $t\bar{t}h$, $tbh\mu \nu$, and $t\bar{t}h\nu \bar{\nu }$ with $h\to b\bar{b}$ and semileptonic top decays. At different energies, different processes dominate the cross section, providing complementary information. At and above an energy of $\mathcal{O}(10)$ TeV, vector boson fusion processes dominate. As we show, in the Standard Model there is destructive interference in the vector boson fusion processes $t\bar{t}h\nu \bar{\nu }$ and $tbh\mu \nu$ between the top quark Yukawa and Higgs-gauge boson couplings. A CP-violating phase changes this interference, and the cross section measurement is very sensitive to the size of the CP-violating angle. Although we find that the cross sections are measured to $\mathcal{O}(50\%)$ statistical uncertainty at $1\sigma$, a 10 and 30 TeV muon collider can bound the CP-violating angle $|\xi |\lesssim 9.0^{\circ }$ and $|\xi |\lesssim 5.4^{\circ }$, respectively. However, cross section measurements are insensitive to the sign of the CP-violating angle. To determine that the coupling is truly CP violating, observables sensitive to CP-violation must be measured. We find in the $t\bar{t}h$ process the azimuthal angle between the $t+\bar{t}$ plane and the initial state muon+Higgs plane shows good discrimination for $\xi =\pm 0.1\pi$. For the $tbh\mu \nu$ and $t\bar{t}h\nu \bar{\nu }$ processes, the operator proportional to $\left({\vec{p}}_{\mu }\times {\vec{p}}_h\right)\cdot {\vec{p}}_t$ is sensitive to the sign of CP phase $\xi$. From these observables, we construct asymmetry parameters that show good distinction between different values and signs of the CP violating angle.

Comments: v2: Matches published version, 33 pages, 11 figures, typos fixed, references added, discussion expanded, results unchanged; v1: 32 pages, 11 figures