First draw the circuit with positive power at the top negative at bottom, power currents generally flowing down, and signals feeding left to right. If you do that, two useful things happen. First, many circuits will be drawn similarly most of the time, and you learn to recognize them after a while. Second, you will confuse yourself and anyone you ask to help you less in what is actually going on and what you hooked up where.
Redrawing the schematic so as to better illuminate the circuit, we have:
It is obvious why the LED doesn't come on, or blips on for a short time at best. That is because it is in series with capacitor C1. Capacitors block DC current. There can't be any sustained current thru the LED.
What you probably intended was something like this:
This allows the capacitor to be like a small reservoir for the LED. It will keep the LED lit for a short time after the transistor is shut off.
With this circuit you can see how a little base current can control a larger collector current, which is how a bipolar transistor is used to make circuits with gain.
However, the values don't seem right for what I think you want this circuit to do. Most LEDs are rated for 20 mA maximum, so R2 should be sized to that this can't be exceeded. Let's say it's a green LED and drops 2.1 V at full current, and that the transistor would drop another 200 mV. That leaves 9.0V - 2.1V - 200mV = 6.7V accross R2. From Ohm's law, 6.7V / 20mA = 335Ω, which is the minimum resistance to keep the LED current within spec. Therefore use the next higher common value of 360 Ω. That still results in nearly 19 mA LED current. You won't notice the brightness difference between 19 mA and 20 mA even in a side by side comparison.
Another problem is that there isn't enough base current to reliably light the LED to its full value. Let's say the B-E junction drops 600 mV, then there is 8.4 V accross R1, which results in 84 µA. Let's say you can count on a gain of 50, so the minimum LED current is only 4.2 mA. That's enough to see it light up on your desk, but not to reach full brightness. In reality, you will likely get a gain higher than 50, so you will get more LED current, but relying on that is bad design.
Let's work backwards to see what R1 should be to fully turn on the LED. Again we'll assume the transistor has a gain of 50, and we've already said the maximum LED current is about 20 mA. 20mA / 50 = 400µA. With 8.4 V accross R1 from above and using Ohm's law again, the maximum R1 value is 8.4V / 400µA = 21kΩ, so the common value of 20 kΩ would make this a nice and reliable circuit if the intent is to light the LED to full brightness.
I would use a relay for this. A relay provides electrical isolation between the controlling circuit and the controlled circuit. You would not need to know anything about the controlled circuit: whether either side is grounded, polarity, voltage, AC/DC, etc., as long as the relay contacts are rated for the voltage and current they will need to handle.
Best Answer
The purpose of the resistor is probably to deal with "stuff happens". It's only dropping 1 volt, so the current sink still has about 4 V to work with.
As you say though, it's not really needed, and can just as well be left off, as was done in the bottom schematic. This is one of those personal whims of the designer, and the fact that the same designer used it in one place but not in another shows how he was on the fence about it too.
Personally, I would just leave it off.