But with its 16th Century castle steeped in the history if Henry VIII’s chaotic rule, a host of beautiful hotels and some stunning walks it is hard not to see the pull of this fishing village.