Baltersan Castle is thought to have inspired Charles Rennie Mackintosh and was visited by both Robert Burns and John Keats.