She will stay as caretaker Prime Minister until a new leader is chosen, a process likely to take several weeks.