Towards the southwest of the Shivsagar tank, it is located this unique open-air sanctuary away from the main group of temples. It was dedicated to the sixty-four Yoginis, believed to be manifestations of the Great Goddess. This is the only shrine at the site that is aligned not east west, but is oriented to the northeast.

The sanctuary, erected on a low rocky mount, consists of sixty-seven cells, which was larger than the rest. Each of the smaller cells used to house a Yogini, while the larger cell had an image of Durga-Mahishasuramardini, inscribed with the label `Hinghalaja`. In 1865, there were only three images, one of the goddess Hinghalaja in the principal cell and the two Matrikas Brahmani and Maheshvari in the cells besides. These three images are now at the Site Museum, and so is the dancing Ganesha who faced the Yogini sanctuary. One gets a breathtaking view of the Kandariya Mahadeva temple, from the ChausatYogini shrine.