People aren't loyal to you, they are loyal to what they need from you. When that need changes, so does their loyalty.