Leaving Canberra was the last thing I wanted - Lee