I bought 15 more hermits and two emeralds yesterday and he immediately went after one of the emeralds.
I ordered the sedative yesterday and will be going that route. I can't take the rocks out because I cemented them together and against the egg-crate base under all the live-sand. Hopefully the hermits will keep him busy and protect the other fish.