Remains of The Old Citadel approximately 20 metres south of The Citadel

The remains of The Old Citadel, located approximately 20 metres south of The Citadel in Weston-under-Redcastle, is a house that dates back to around 1785. It was built for Sir Richard Hill, the second baronet of Hawkstone, for his steward, George Downward. Currently, it is largely demolished, with only a small part still standing, which is now used as a store shed.

The structure features red sandstone ashlar and has a gable-fronted roof made of machine tiles with raised verges. It is two storeys high and has a flush floor band at the front. The first floor includes two blind roundels and a simple semi-circular arch with a plain tympanum and imposts below. There is a late 19th-century door flanked by blind mock gun-loops. On the left side, there are three 19th-century casement windows grouped together at the centre, with the middle one set in an 18th-century opening that has a keystone. There is also a 19th-century casement window directly below the eaves at the centre.

To the right, there is a taller parallel gabled range that is also part of the original Citadel. However, the front gable of this range has been entirely rebuilt in late 20th-century brick and is not considered to have special architectural interest.

The Citadel was designed to resemble an 'ancient castle', inspired by the Hill family coat-of-arms, but it was largely demolished around 1824 to make way for the current Citadel. Apart from the surviving fragment, the rest was demolished around 1960. The remains are included for their group value.