The local people call this temple by the name 'Vettuvar Koil'. The front terrace of the Kazhugumalai temple is lined with two friezes of ganas (demons). The sculptor has carved even the smallest one of them with full attention. There is a representation of a musical rendezvous of these ganas here, which shows one playing musical instrument, another dancing etc.
In case of any other temple, the top of the vimana (tower over the sanctum) can be seen and appreciated from a distance but here in the Kazhugumalai temple it is upside down. It is octagonal and decorated with lion heads. There are outstanding art pieces in the four vimanas of this temple. Siva and Parvathi can be seen in the east, Dakshinamurthi in the south, Narasimha in the west and Brahma on lotus in the north.
In the Kazhugumalai temple, Lord Dakshinamurthi is seen in unique pose playing a mirudangam (drum), which cannot be seen anywhere. The 'Vishabarana' aspect of Lord Siva holding a Naga is portrayed here. The cobra is shown squirming out of His hold and it looks so lifelike. Jain figures like Tirthankaras, Yakshas and Yakshinis are displayed in a nearby big rock.