Jayo
Do you think I should try to remove them?
I would remove all of your substrate and soak all rocks and wood with Peroxide. Allow rocks and wood to dry completely. Id also replace your substrate because those things multiple fast. Also to be safe, remove all media and replace as well.