This two-storey house with mullioned windows and a steep slate roof stands against the old walls of the fortress. The south-facing residence of the governor became the clerk's office and home of the chief warden when the fortress served as a prison; Jean-Louis de Nogaret de La Valette, Duke of Épernon, was the best-known governor.