Think of where you are right now. You are not the passenger of a vehicle telling a driver to have patience. We’re specifically discussing the situation from an outside perspective. “Have patience” is useful advice for someone actively driving a car stuck behind passing trucks. It comes across as condescending when you bring it into a discussion about whether passing truck drivers are in the wrong or not.