Clitheroe Castle, Gates and Grounds