The historical excavation has revealed important facts about the forts of Berhampur. The fort of Potagarh is a significant one. To all the people of Orissa it is popularized as buried fort. The reason is that it is found in a dilapidated condition. Strategically, this fort is located near Ganjam village between 180 15' and 200 15'N Latitude and 830 49' and 850 15' E longitudes. It is on the mouth of river Rushikulya. Although it is in ruins it stands as a standing edifice highlighting the glorified days of several kings. Over the years all these kings have utilized it as the administrative headquarters so that they could efficiently rule over the region. Different periods like Kalinga, Kalinga Dandapat, Ganjam, Chichacole Circar etc.
This fort of Potagarh is not an individual fort. Rather it is a cluster of forts, which are erected by several governments. Experts said that fort of Potagarh is built in the year 1768 under the supervision of Edward Costford, who was the first resident of Ganjam. The design if this fort is quite unique. The fort is star shaped covering a large area close to the river. Inside the compound of this fort several buildings are found. For example there are 3 residential buildings. Their designs are unique and have got no similarity with each other. Probably they have allotted to different community people like Mahammadans, French and British. 2 magazine houses also are found within the premises. There is a compound wall which is about 8' thick One can also found 2 passage ways in the east side of the compound wall which has got opening to the river.
Perhaps one passage was used for escaping into the sea. Another one is used by the queens while taking bath in to the river. There is a ditch dug as a fortification and usually filled with water. It encircles it. 2 The fort consists 2 doors. They are quite well decorated and they are placed differently. One is located in the front side and another one is located in the backside, near the river.
Centered on this fort of Potagarh, legends are popular. Some talks about the rage of the fort-goddess on Ganjam village. It is also heard that while faced attacks king makes an escape through the secret passage into the Bay of Bengal by a boat. Truly, this fort of Potagarh has an archeological significance.