Why not just wait and see if whatever this creature is actually causes any problems? If its a little pistol, I highly doubt its going to kill anything in your tank. If its a mantis, then it may become a problem but I think if it was me I would just wait it out and see what happens.
By the way, it sounds just like my pistol shrimp.