Is it be correct to say that the CSR = ESR + external resistor = 1.3 + 0.5 = 1.8 ohms?
According to a footnote in the datasheet, "CSR(compensation series resistance) refers to the total series resistance, including the equivalent series resistance (ESR) of the capacitor, any series resistance added externally, and PWB trace resistance to CO."
In most cases, the trace resistance will be small enough that you can ignore it, and your formula would be correct enough.
Now I would much rather use a ceramic cap, which from what I've read, has an ESR in the milliohms.
Remember that a ceramic cap in the 10 - 15 uF range is going to be fairly large, which can cause reliability issues (due to mismatched CTE between the cap and board).
It looks like a CSR of 0.1 to 2 ohms would be sufficient.
Notice, comparing figs 28 and 29, that the required CSR changes depending on the capacitor value.
And your capacitor value will change depending on voltage and temperature. But 1-3 Ohms total resistance seems to be okay for any capacitance value.
If I use a ceramic cap instead of the tantalum, and if I add an external resistance of say 1 ohm would this yield proper operation?
Based on the above, this should work. Be sure that your capacitor will have 10 uF or so minimum value over all operating conditions.
You have identified your issue correctly.
I couldn't figure out exactly what is the maximum current MSP430 can draw on its P1 pin. I found a parameter named "maximum diode current" in the datasheet, which is 2mA, and it is the best guess I can make. However, it is not that this is the current which will be drawn in practice: once the regulator's input voltage will get below ~4.3V, it is hard to predict the rate of discharge.
You can minimize the discharge time by taking smaller capacitors for regulator's input. Why did you add 470uF in the first place? I see in this datasheet (which is the one you should use according to part number in the schematic) that 100nF should suffice.
If the natural discharge is still too slow, you can add bleeding resistor as you did. You can even consider adding pull-down resistor in parallel to P1 pin. If the active power consumption is of high importance, there are more power effective techniques of pulling the voltage down.
GENERAL NOTE:
The usage of bleeding resistors is very common for safety reasons. For example, there are SMPS which utilize huge output capacitors. If you disconnect the load and expose the output pins, these caps can (sometimes) store their charge for minutes. The amount of charge is such that a human touching the outputs can die. In cases like this one, there is common practice to add a bleeding resistor (usually power resistor) in parallel to the output capacitors.
Best Answer
According to datasheet section 9.1.1 about input capacitor, it prevents large voltage transients at the input, and provides instantaneous current for the switching.