It takes my dogs a little while to get back to normal when we've been gone. Of course your dog isn't "mad" at you. Their brains don't work that way, but he was probably stressed even though he knows your brother. Change is change and it can be stressful. I would just get right back into your normal routine and watch for any other changes (appetite, poop etc.)