That was really a bad situation for a decent person like you. I had also gone under the same situation. Now onwards I do not refer any body to any one but give both of them in form of information with a disclaimer clause. My wordings are like this. "Go to Co.A and meet with Mr. X he may able to solve your problem." Like wise when communication of Mr X comes in for confirmation take the things like this "Though I had referd to you it would be your call to take the matter up." Diplomacy is what which is required.