with the engine switched off
press brake pedal several times until it feels solid
with the pedal pressed - start the engine - you should feel the pedal sink slightly if the servo is working correctly
if not check as you said for loose/chafed vacuum pipe from manifold to servo unit