Yes, it does seem like the servo assistance is variable. Odd thing is that it seems to come and go.
Al, why did you ask about idle?
Any pictures of what this vacuum pipe looks like?
The brake servo is assisted by vacuum. The vacuum is taken from the plenum which runs at negative pressure when the throttle is closed, although throttle will vary on Dbw cars to allow tick over.
But, if there is a leak in the vacuum pipe for instance, (or anywhere else in the plenum connections such as the breather system for that matter) then that means more air is getting in to the plenum, and hence the engine inlet, than the maf has metered and more than the throttle has allowed. So the tick over will affected.
Throttle let's sir in. Air in means more revs. Let more air in anywhere else also means more revs. Therefor a vac leak means more revs, and as Al suggested, an uneven tick over.
Uneven, because is air gets in and the revs go up, the ecu will see this and close the throttle tickover setting to try to maintain 550rpm at all times. So the idle/tickover speed will go up and down and sometimes almost stall as the ecu tries to juggle the numbers and keep the engine idle speed constant. If it didn't, the tickover would sit at say, 1000rpm depending on how bad the leak is.