I kinda agree with you. I do not remember a hindu scripture prescribing anything about a non hindu entering temple. BTW you can't find the word hindu anywhere in todays sectarian hindu scriptures. But tantry should be allowed to punnyaham as it pleases to him.