Its funny how that virtue is always used in that context
Patience, in the context of a virtue, is to tolerate people even if they do things you dont like or agree with, instead of allowing yourself to lose your patience and get angry, or resolve the situation negatively.
Patience used in your context has to do only with yourself, as opposed to how you are against other people, and has more to do with the time to get something done than the amount of tolerance you have for a person/people.