The same happened with his two grandsons, Al-Hassan and Al-Hussein (May Allah be pleased with them), when they grew up a little, and were able to toddle around, they very frequently wandered out of their house into the Prophet’s masjid (i.e. mosque). If the Prophet (Peace and blessings be upon him) was in the middle of a khutbah (i.e. sermon), he would immediately stop, descend from the pulpit, take them in his arms, carry them back, and seat them beside himself on the pulpit, and then he would resume his khutbah.