The shorthand of using a duration number only applies to notes, not rests.
As per the NR:
Isolated durations – durations without a pitch – that occur within a music sequence will take their pitch from the preceding note or chord.
That is how it is. More learned fellows may be able to offer the technical explanation underlying this.