Messenger of Allah ﷺ said to me, "Were your people not close to the Pre-Islamic period of ignorance, I would have demolished the Kaʿba and would have rebuilt it on its original foundations laid by Abraham (for Quraish had curtailed its building), and I would have built a back door (too)."  

لِي رَسُولُ اللَّهِ ﷺ لَوْلاَ حَدَاثَةُ قَوْمِكِ بِالْكُفْرِ لَنَقَضْتُ الْبَيْتَ ثُمَّ لَبَنَيْتُهُ عَلَى أَسَاسِ إِبْرَاهِيمَ عَلَيْهِ السَّلاَمُ فَإِنَّ قُرَيْشًا اسْتَقْصَرَتْ بِنَاءَهُ وَجَعَلْتُ لَهُ خَلْفًا قَالَ أَبُو مُعَاوِيَةَ حَدَّثَنَا هِشَامٌ خَلْفًا يَعْنِي بَابًا  

(the wife of the Prophet) that Messenger of Allah ﷺ said to her, "Do you know that when your people (Quraish) rebuilt the Kaʿba, they decreased it from its original foundation laid by Abraham?" I said, "O Messenger of Allah ﷺ! Why don't you rebuild it on its original foundation laid by Abraham?" He replied, "Were it not for the fact that your people are close to the Pre-Islamic Period of ignorance (i.e. they have recently become Muslims) I would have done so." The sub-narrator, ʿAbdullah (bin ʿUmar ) stated: ʿAisha 'must have heard this from Messenger of Allah ﷺ for in my opinion Messenger of Allah ﷺ had not placed his hand over the two corners of the Kaʿba opposite Al-Hijr only because the Kaʿba was not rebuilt on its original foundations laid by Abraham.  

عَنْ عَائِشَةَ ؓ زَوْجِ النَّبِيِّ ﷺ أَنَّ رَسُولَ اللَّهِ ﷺ قَالَ لَهَا أَلَمْ تَرَىْ أَنَّ قَوْمَكِ لَمَّا بَنَوُا الْكَعْبَةَ اقْتَصَرُوا عَنْ قَوَاعِدِ إِبْرَاهِيمَ فَقُلْتُ يَا رَسُولَ اللَّهِ أَلاَ تَرُدُّهَا عَلَى قَوَاعِدِ إِبْرَاهِيمَ قَالَ لَوْلاَ حِدْثَانُ قَوْمِكِ بِالْكُفْرِ لَفَعَلْتُ فَقَالَ عَبْدُ اللَّهِ ؓ لَئِنْ كَانَتْ عَائِشَةُ ؓ سَمِعَتْ هَذَا مِنْ رَسُولِ اللَّهِ ﷺ مَا أُرَى رَسُولَ اللَّهِ ﷺ تَرَكَ اسْتِلاَمَ الرُّكْنَيْنِ اللَّذَيْنِ يَلِيَانِ الْحِجْرَ إِلاَّ أَنَّ الْبَيْتَ لَمْ يُتَمَّمْ عَلَى قَوَاعِدِ إِبْرَاهِيمَ