as long as you have plenty of rock so that all the bioload is not being managed by the filter alone. so if you have plenty of rock than take it off if you want
I would add some more rock if it were my tank. Also be careful removing something you have been continuously using. It can create a crash in your tank. I would slowly cut back the use of the canister a little each day once you have everything else in place.