Messenger of Allah ﷺ said to me, "Were your people not close to the Pre-Islamic period of ignorance, I would have demolished the Kaʿba and would have rebuilt it on its original foundations laid by Abraham (for Quraish had curtailed its building), and I would have built a back door (too)."
لِي رَسُولُ اللَّهِ ﷺ لَوْلاَ حَدَاثَةُ قَوْمِكِ بِالْكُفْرِ لَنَقَضْتُ الْبَيْتَ ثُمَّ لَبَنَيْتُهُ عَلَى أَسَاسِ إِبْرَاهِيمَ عَلَيْهِ السَّلاَمُ فَإِنَّ قُرَيْشًا اسْتَقْصَرَتْ بِنَاءَهُ وَجَعَلْتُ لَهُ خَلْفًا قَالَ أَبُو مُعَاوِيَةَ حَدَّثَنَا هِشَامٌ خَلْفًا يَعْنِي بَابًا