It has been narrated on the authority of Anas b. Malik that the Messenger of Allah ﷺ would not come (back) to his family by night. He would come to them in the morning or in the evening. (Using translation from Muslim 1928a)   

«كَانَ رَسُولُ اللهِ ﷺ لَا يَطْرُقُ أَهْلَهُ لَيْلًا يَقْدَمُ غُدْوَةً أَوْ عَشِيَّةً»