Well... well yeah, but there are times when I am weak--

Look, that's not the point. Point is there are times when you really shouldn't agree with shit someone says. In fact, you should probably default to not saying anything unless the person is specifically waiting for you to say something. Like, if they're giving you an expectant look or something.