Far from being a sanctuary for the rich and famous, one of Britain's most expensive enclaves has seen people leave in the ...