Authority is validated by the agreement of the people under the authority, not by the one who holds the authority.
Authority is based on agreement. It is not the same thing as power. Power can be wielded via force. Authority must be validated by agreement. If the agreement is withdrawn, the authority is no longer valid.
The person who holds the authority might then choose to wield power maintained by force, compulsion, manipulation, or threat in order to maintain the “position of authority.” But the actual authority is gone. When the agreement which validates authority is gone but the person refuses to vacate the position of authority, they are no longer a leader but a tyrant. They are invalidated. Their rule is unlawful, their proclamations meaningless.