All Saints Cathedral was designed by William Emerson, who later designed the Victoria Memorial in Calcutta, and was consecrated in 1887. It is built in white sandstone in a thirteenth-century Gothic Revival manner.

Locally it is known as Patthar Girja, the stone church. The stained glass and the carved marble altar are the things to look at, along with the proportions of the nave, which are considerably more ambitious than the city's other colonial churches.

It stands on a roundabout in Civil Lines and remains an active cathedral rather than a monument.