Hadith Sahih Bukhari Volume 2, Book 26, Number 671: Narrated Ibn Abbas:
When Allahs Apostle came to Mecca, he refused to enter the Kaaba with idols in it. He ordered (idols to be taken out). So they were taken out. The people took out the pictures of Abraham and Ishmael holding Azlams in their hands. Allahs Apostle said, "May Allah curse these people. By Allah, both Abraham and Ishmael never did the game of chance with Azlams." Then he entered the Kaaba and said Takbir at its corners but did not offer the prayer in it.