The Palace was originally built to house Janardan Upadhyay (Garg) of Uttar Pradesh, who often came to the region for business. The famous Krishna Temple, Gopaljee Temple, is situated in the courtyard of this palace.
Built under the rule of Rani Janki Devi, the temple also has idols of Lord Shiva. Jagannath Temple and Natmandir are positioned on either side of the entrance. The area comprises two palaces, an old one and a new one. The new one is inhabited by the successors of the royal family. The ground floor rooms have a good collection of stuffed bodies of animals, paintings, furniture etc. These can be seen on request.