Who told you we worship that black stone which is called KABA,,,, There are some ritual formalities which we perform there. Please also keep it mind Kaaba is an Centre point for our kibla (direction for prayer) all over the world therefore we are not bowing to that Kaaba, its just our direction of prayer and also keep it mind we are bowing to only one ALLAH (God) because everything is belong to ALLAH.