Meghan Markle and Prince Harry said ‘this is the end’ years before they quit royal family