From the beginning, the River Cafe in London has been hard to get to and even harder to get into.