I was "kicked for exploiting". I was under the keep macroing fire magic.

So no, you can't avoid them under the keep.