Search for lepton flavour violating decays of the Higgs boson to μτ and eτ in proton-proton collisions at $$ \sqrt{s}=13 $$ TeV

Abstract

Abstract A search for lepton flavour violating decays of the Higgs boson in the μτ and eτ decay modes is presented. The search is based on a data set corresponding to an integrated luminosity of 35.9 fb−1 of proton-proton collisions collected with the CMS detector in 2016, at a centre-of-mass energy of 13 TeV. No significant excess over the standard model expectation is observed. The observed (expected) upper limits on the lepton flavour violating branching fractions of the Higgs boson are ℬ(H → μτ) &lt; 0.25% (0.25%) and ℬ(H → eτ) &lt; 0.61% (0.37%), at 95% confidence level. These results are used to derive upper limits on the off-diagonal μτ and eτ Yukawa couplings $$ \sqrt{{\left|{Y}_{\mu \tau}\right|}^2+{\left|{Y}_{\tau \mu}\right|}^2}&lt;1.43\times {10}^{-3} $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:msqrt> <mml:mrow> <mml:msup> <mml:mfenced> <mml:msub> <mml:mi>Y</mml:mi> <mml:mrow> <mml:mi>μ</mml:mi> <mml:mi>τ</mml:mi> </mml:mrow> </mml:msub> </mml:mfenced> <mml:mn>2</mml:mn> </mml:msup> <mml:mo>+</mml:mo> <mml:msup> <mml:mfenced> <mml:msub> <mml:mi>Y</mml:mi> <mml:mrow> <mml:mi>τ</mml:mi> <mml:mi>μ</mml:mi> </mml:mrow> </mml:msub> </mml:mfenced> <mml:mn>2</mml:mn> </mml:msup> </mml:mrow> </mml:msqrt> <mml:mo>&lt;</mml:mo> <mml:mn>1.43</mml:mn> <mml:mo>×</mml:mo> <mml:msup> <mml:mn>10</mml:mn> <mml:mrow> <mml:mo>−</mml:mo> <mml:mn>3</mml:mn> </mml:mrow> </mml:msup> </mml:math> and $$ \sqrt{{\left|{Y}_{\mathrm{e}\tau}\right|}^2+{\left|{Y}_{\tau \mathrm{e}}\right|}^2}&lt;2.26\times {10}^{-3} $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:msqrt> <mml:mrow> <mml:msup> <mml:mfenced> <mml:msub> <mml:mi>Y</mml:mi> <mml:mrow> <mml:mi>e</mml:mi> <mml:mi>τ</mml:mi> </mml:mrow> </mml:msub> </mml:mfenced> <mml:mn>2</mml:mn> </mml:msup> <mml:mo>+</mml:mo> <mml:msup> <mml:mfenced> <mml:msub> <mml:mi>Y</mml:mi> <mml:mrow> <mml:mi>τ</mml:mi> <mml:mi>e</mml:mi> </mml:mrow> </mml:msub> </mml:mfenced> <mml:mn>2</mml:mn> </mml:msup> </mml:mrow> </mml:msqrt> <mml:mo>&lt;</mml:mo> <mml:mn>2.26</mml:mn> <mml:mo>×</mml:mo> <mml:msup> <mml:mn>10</mml:mn> <mml:mrow> <mml:mo>−</mml:mo> <mml:mn>3</mml:mn> </mml:mrow> </mml:msup> </mml:math> at 95% confidence level. The limits on the lepton flavour violating branching fractions of the Higgs boson and on the associated Yukawa couplings are the most stringent to date.