The issue is not if muslims pay or do not pay taxes. With your own admission, 85% are not muslims and these 85% of the tax payers think that it is not needed to go on Haj for salvation. Then why the Government should make them pay for Haj? For me, Haj is just a waste of time, instead of going that far to see the dissecrated shivaling, why dont you go to any one of 18 shivalings in India itself?
There is no objection, if the Government provides subsidies to Muslims via special Haj tax to be levied only on Muslims. Hindus have no business to pay your subsidies. It is foul.