The deputy prime minister, Angela Rayner, has left the government following admitting that she underpaid stamp duty on a flat she bought in Hove, East Sussex.

Rayner, who was also housing secretary, had claimed that the underpayment came about after she received incorrect advice from her conveyancers – a claim denied by the conveyancing firm who advised her, Verrico & Associates.

Earlier in the week, prime minister Keir Starmer had vowed to stand by his deputy, who referred herself to the independent ethics adviser.

In a statement this week, Rayner said: “I deeply regret the error that has been made. I am committed to resolving this matter fully and providing the transparency that public service demands. It is for that reason I have today referred myself to the independent adviser on ministerial standards, and will provide him with my fullest cooperation and access to all the information he requires.”