John Bercow has long been pretty unpopular with Conservative MPs, of course, and his wife's notorious photo has made his Tory critics even more angry.
The interesting question is whether he is in danger of losing support among Labour MPs - after all, it was they who got him elected in the first place.
Many MPs admire the way he has reformed Commons procedures, speeded up debates, and allowed more urgent questions.
Indeed, the Shadow Leader of the House Hilary Benn was very complimentary towards Bercow in the chamber yesterday.
But some experienced Labour members to whom I spoke today were very angry with the latest developments.
One said the Sally Bercow photo made her look like a prostitute. Another told me it was "outrageous", adding that "she has brought the office into disrepute and is undermining her husband at a rate of knots".
Many Labour MPs, especially women members, voted for him in the expectation that he would be the champion of MPs with families.
They feel Bercow has been no help in the ongoing disputes between MPs and the new Parliamentary expenses authority, Ipsa.
"People are fed up," says one Labour front-bencher. "He has let us down with Ipsa."