Well I think the temple is well within its rights to allow or disallow anybody. If the temple authorities feel that people belonging to a certain religion are interestd only in sight seeing, then it has the right to prevent such people. A temple is not a museum. If i build a house, it does not mean that I allow anybody to enter it.