[otrs] Auto response templates

Hi - when I change an auto-response to ‘invalid’, why doesn’t it stop sending the auto-response? I have disassociated it from the agent’s queue, and it still will send out. What am I not understanding? How do I turn these off exactly? We use these when our agents are out-of-office, and it’s fine, but when the agent comes back, I can never get the auto-responder to stop. Thank you, Leah