The Fox Almshouses in Norton High Street, 2000. (Photo courtesy of Mr Robert Harbron) 
Picture Stockton Archive
A Pictorial History of Stockton-on-Tees
The Fox Almshouses in Norton High Street, 2000. (Photo courtesy of Mr Robert Harbron)
My information is that the house you describe as a reading room and chapel was a bath house, of course the function of that house may have changed over a period of time.
Erected in 1897 on the will of John Fox, Brewer of Norton, as part of the Diamond Jubilee Celebrations of Queen Victoria. These buildings are still in trust. The building to the left was originally a reading-room, community house and, on Sundays, a Chapel for those unable to attend St Marys on The Green, due to infirmity. This photo was taken as part of “The Village in the Millennium Year”.