Whatever John Tory has, the voters in Ontario never seemed to want it. And now, it seems, the Progressive Conservative party he's led since 2004 agrees.

Tory handed in his resignation Friday after he lost a by-election in Haliburton-Kawartha Lakes-Brock. Liberal Rick Johnson took the seat in the riding thought to be a safe one for the party.

In five years, Tory was elected to public office just once: He ran for Mayor of Toronto in 2003 but was defeated by David Miller. In 2005, he won a seat in Dufferin-Peel-Wellington-Gray after Ernie Eves stepped aside, but was crushed by Education Minister Kathleen Wynne during the 2007 vote.

And finally, he attempted to regain a seat at Queen's Park by running in the Kawartha riding. But voters overwhelmingly rejected him after he was accused of being a 'parachute' candidate.

MPP Laurie Scott had given up her seat so that Tory could run. Instead, the riding went red.

And that spelled his doom, a fact he admitted on Friday.