I can imagine your situation and I feel sorry for the same. Yes, you are right, I think it takes a huge change to accept Muslims in the mainstream. Albeit, commoners can accept and adore Muslim celibrities, they seem to be harsh when it comes to realities.
I have something to share with you on this. I am part of a very popular voluntary organisation. For some reasons, it is regarded as pro-Hindu from many Muslims. I was trying to advocate one of the foundation's programs by standing in a nearby park and distributing flyers to the passersby, who were predominantly early morning walkers. I made no distinction between a Hindu and a Muslim. I am sure that the organisation I represent doesnt make any distinction either.
I saw a middle aged Mulsim man with flowing beard walking in the park. He had noticed the banner of the organisation and had seen me distributing flyers to people in front of him.When he approached me, he thought it wasnt meant for him and began walking forward with a grin on his face,ignoring my existence.I reached out to him and gave him the hand-out and explained the program of my organisation. He was pleased. He shook my hands and felt pleased for being accepted.