In the scene where everyone is eating the crab dinner, you'll notice that Bob is wearing a napkin in his shirt. When he talks about taking Maggie hiking on the mountain, you see him tucking it back in his shirt.....

He never took it out in the first place.