Datasheet or termal resistance for this heatsink

That appears to potentially be a really good idea - but calculating the effective thermal resistance would be immensely difficult, whereas trying it in practice would be quite easy. I'll try neither at present (the latter is your assignment :-) ) but the following observations may help.

My first reaction was that the thermal transfer from case to spring (Rt_CS) would be very high, but you have added the (reasonable) assumption that enough thermal paste is used to make "pretty good" [tm] contact between case and spring.

Assuming that your spring area calculation is correct, that's the same area as plates of about

• 20mm x 20mm / 32 x 12.5 / 25.4 x 15.7

• ~= 0.8" x 0.8" / 1.3" x 1/2" / 1" x 0.6"

That's a useful piece of heatsink compared to a TO92 case.
You state datasheet figures of θ_JA = 160°C/W and θ_JC ~= 66 °C/w,
so θ_CA = 160 - 66 = 94°C/W
Even allowing for the poor thermal conductivity of the spring (steel?) I'd guesstimate a halving in effective θ_CA so you'd hope for a θ_JA of around 110°C/W.

That assumes θ_SA of about 50°C/W

For comparison, Aavid make several TO92 heatsinks of a "more usual" style.
The diaagrams and tables below were taken form page 68 of their excellent catalog - here. Effectiveness of course varies with size and area, but the tables suggest that they approach 10°C/W when used in a hurricane and more like 25°C/W as air speed approaches zero. Area of the smaller 575200 heatsink is somewhat under 400 mm^2 both sides. They have added some punch outs to improve airflow, the material is optimised for high thermal conductivity and there is a broad path for heat energy from TO92 case to the outer upper edges. So superior performance to your spring would be expected, and the original ~~~= 50°C/W is probably an OK starting guesstimate.

Note that the Aavid heatsink is shown in some places as 60 K/W. That's presumably a notional still air value. If the air is still there is no convective transfer, and air convection happens as temperature differential rises, but how well your spring does at encouraging this is TBD.

You could easily wind a "spring" using thick copper wire with a mandrel such that it would slip only a TO92 case and then be able to be lightly crimped in place with thermal paste to suit. If the spring was crimped against the TO92 case with eg pliers and then slightly more tightly just above the case to stop it sliding down onto the PCB then a reasonably stable, cheap and easily made heatsink could result. Or you could slide it right down to board level and solder the end to a pad.

Best of all would be to try it in real life.
Obtain a semi-sacrificial TO92 device - say a cheap bipolar transistor. Use a consistent environment. Minimise artificial airflow and mount within an open box or whatever that roughly models intended use. Finger access required.

Connect say base to collector directly or via a resistor of choice and use a variable power supply to adjust dissipation until it was about too hot to hold onto for more than a few seconds. That's typically about 55°C. Use a thermometer that is suitable (eg IR non contact) if you have one, but fingers sufficeth.
Measure and save mW.
Now add spring, measuring temperature at TO92 case for similar result. Allow time to stabilise after adjusting power.
Measure and report back.

RELATED:

A zillion idea starters

Digikey AavidTO92 heatsink

Excellent Aavid heastink catalog

Aavid retail example - 36 C/W claimed

Aavid similar to above TO92 - 60 K/W claimed - Hmmm

Well, here is the basis for the rating from Vishay-Dale's datasheet:

30cm x 30cm x 3mm thick is probably considerably more than your PCB area, and the thermal conductivity of the PCB is not as good as solid aluminum so your heat spreading will not be as good. Even if it was (which it isn't), the temperature rise acceptable for an aluminium and ceramic resistor may be excessive for your PCB material.

You might be able to get 10W continuous out of it. An alternative would be to buy a finned heatsink with specified °C/W rise and design for a reasonable rise in temperature at whatever you consider to be worst-case normal operating conditions. You could consider adding a fan, but that would require a power source.