"I was with Ibn Abbas, and Mu'awiyah would not pass any corner without touching it. So Ibn Abbas said to him: 'the Prophet would not touch any besides the Black Stone and the Yemeni corner.' So Mu'awiyah said: 'There is no part of the House that is untouchable.'" (Using translation from Tirmidhī 858)
ابْنُ عَبَّاسٍ إِنَّ رَسُولَ اللهِ ﷺ لَمْ يَكُنْيَسْتَلِمُ إِلا الْحَجَرَ وَالْيَمَانِيَّ فَقَالَ مُعَاوِيَةُ لَيْسَ شَيْءٌ مِنَ البَيْتِ مَهْجُورًا