Island city seen as one of the most desirable for homebuyers, but where does that leave residents