Another thing that comes to mind is I think that nasty fiberglass is the culprit that damages the potentiometers and probably can make its way into the spiderweb around the back of the woofer .
Nonetheless I have always stuck with the original insulation as well. I’ve restored many but I’m not as good as you by a long shot, you do beautiful work!