Since I spent 20 minutes trying to diagnose it this morning...
Say you have a session open. That session invokes a query that hits a linked server.
Now change the linked server. Drop and recreate, point it at a different server.
New sessions get the new definition, but existing sessions use the old definition.