A tranquil haven, the house and gardens remain secluded from the outside world and one of the most magical locations in England