Summary: Recently, H. Huang [Ann. Math. (2) 190, No. 3, 949–955 (2019; Zbl 1427.05116)] gave a very elegant proof of the Sensitivity Conjecture by proving that hypercube graphs have the following property: every induced subgraph on a set of more than half the vertices has maximum degree at least \(\sqrt{d}\), where \(d\) is the valency of the hypercube. This was generalised by N. Alon and K. Zheng [Adv. Comb. 2020, Paper No. 11, 12 p. (2020; Zbl 1455.05022)] who proved that every Cayley graph on an elementary abelian 2-group has the same property. Very recently, A. Potechin and H. Y. Tsang [“A conjecture on induced subgraphs of Cayley graphs”, Preprint, arXiv:2003.13166] proved an analogous results for Cayley graphs on abelian groups. They also conjectured that all Cayley graphs have the analogous property. We disprove this conjecture by constructing various counterexamples, including an infinite family of Cayley graphs of unbounded valency which admit an induced subgraph of maximum valency 1 on a set of more than half the vertices.