After the poker game when the guys find out Andy is a virgin, he is going to work the next day. He has his backpack on when he is going through the door, and as soon as he gets through it, he has it in his hand.

He could have taken it off when he was coming through the door