Hertz is 1/second. So N in your formula is Watts. The formula is not for noise voltage figure but for noise power. Power is watts, so everything computes OK.
To fully answer your question, noise is measured either in absolute units or as a ratio. Relative unitless ratio is just a number. For each untiless number scale there is always some absolute value in physical units which is agreed upon. Say if reference number is milliwatt, then microwatt of noise is 0.001 unitless on milliwatt scale. Or logarithmically -30dBm or -60dBW, etc.
Side note: non zero thermal noise strictly speaking has no absolute maximum voltage amplitude for infinite period of observation. Every observed momentary value can always be exceeded in any of next observations. Saying that noise is 0.01V p-p (peak to peak) is oversimplification or misuse of terminology. Preferred quantification of noise is in any units but with note of the method of observation, like 0.5A rms (root mean square).
Reading the question and the comments, there may be a conceptual misunderstanding : the attenuator WILL attenuate any noise presented on its input (even from just a 50 ohm source impedance), to the same extent it attenuates the signal.
However it also generates noise of its own, which may be represented as the noise from a perfect resistor equal to its own output impedance, and this is added at the output to the (attenuated) input signal and noise. So if input and output Z are both 50 ohms, the net result is attenuated signal + marginally increased noise (i.e. NF = attenuation).
But if its output impedance is lower, the added noise is also lower, thus improving the noise voltage as Andy states.
So represent the attenuator as a perfect attenuator (attenuating noise) in series with a Johnson noise voltage source equal to the output impedance. The rest is just applying the formulae.
EDIT: re: updated question.
(1) There is nothing special about 290K except that it's a realistic temperature for the operation of a passive circuit. The reason they chose it is that the article quotes a noise floor ( -174dBm/Hz) which is correct for a specific temperature : yes, 290k.
(2) While any resistance in the attenuator will contribute noise, I realise that it is not a satisfactory explanation as to why you get the same noise out of an attenuator, because (as Andy says) you could make a capacitive attenuator which is not a Johnson noise generator. So we have to look a little deeper, and remember these noise sources are the statistics of the individual electrons that make up the current.
So, let's say we build a (50 ohm in, 50 ohm out) attenuator, and attempt to cheat Johnson by using a capacitive divider. That implies a node within the attenuator which conducts some of the input current to ground. At this node, we have two current paths; a fraction of the current flows to output, the rest to ground. What determines which path an individual electron will take? Essentially, chance. Collectively? Statistics. So this is a noise source.
Or let's just add series capacitance to provide enough attenuation : we thereby avoid dividing the current flow and eliminate the noise source, right? At the cost of reducing the signal current; our statistics now operate with a smaller sample size and consequently greater variance : more noise.
These results are the best you can do, there is no way round them.
Best Answer
No, what you have is a noise spectral density. To convert that to a voltage you have to consider the bandwidth that is of interest to you. So, if the bandwidth of interest is (say) 100 kHz, then the noise voltage you get in a 100 kHz of bandwidth is this: -
$$35\text{ nV}\times \sqrt{100,000} = 11.07\text{ }\mu V$$
(If the bandwidth of interest was 1 MHz then the noise would be \$35\text{ }\mu V\$).
To convert that to dBm requires knowledge of the nominal impedance of the system (usually 50 Ω or 600 Ω) so, if we assume 50 Ω then a voltage of 11.07 μV produces a noise power of 2.45 pW and, 2.45 pW is -86.11 dBm.