To the dismay of many locals, the lush mountains and pristine beaches are increasingly attracting the rich and famous.