It is a long question, but better than a short one, as you've shown your own research.
1) Solar cells. If you're stacking your own ones, stack 9 of them and get the 4.5V of the original circuit.
2) Battery charging. Batteries are the only thing you've left out of your spec. This is an area where the circuit design relies on cutting a lot of corners. In theory it might be out of spec, if you were to put 4.5V at 280ma through AA NiMH cells indefinitely. In practice, you don't get full sun all day, you'll be using it indoors, and you're not going to get optimal power transfer from the cells, so this isn't going to cause problems.
3) Diode. It's just a regular diode, not a zener. Current through it is actually determined by the battery and right hand side circuit, not the solar panel - the transistor is off when the panel is generating electricity. The original 1N914 will be fine. 1N4004 will also be fine.
4) Resistors: not a precision component here, use whatever meets your cost constraint. 5.1k for 5k is fine.
5) Wire: not critical. Your ebay link looks suitable. Thinner is better for the toroid.
6) Transistors: stick with the exact part numbers. Design may rely on specific parameters.
7) LED: again, this circuit relies on cheating. Normally a white LED won't run from two NiMH cells. The joule thief part provides a boost converter that gives small pulses of higher voltage. It doesn't have the capacity to provide a lot of current at that voltage. In combination with the pulsing this means there should be no risk of damaging it.
(A proper analysis of this circuit would be good, if nobody else supplies one I'll do it in a few days).
Background:
I have designed a number of LED lighting products which are manufactured in China.
I have several cylindrical LED flashlights that have a large number of LEDs in them
... Are there ultra-bright LEDs that you can drive directly off of 4.5 volts without a current limiting resistor? Or are there special purpose ultra bright white LEDs made for 4.5 volt supply that have internal current limiting resistors?
No and no, unfortunately.
Many LED lights are constructed as you describe, with multiple white LEDs wired in parallel and connected essentially directly across the battery.
They are junk.
They are not "designed".
They build them this way "because they can" and they work well enough to be able to sell them.
When supplied with 4.5V + the LEDs are driven well above their maximum design rating and their lifetimes are greatly shortened. The LEDs used are typically low lifetime low cost devices.
Follow-up question: Does anybody know if the 12 volt LED bulbs that are in landscape lights have a voltage regulator in them?
The 12 volt LED strips usually use 3 LED die in series plus a series resistor.
Turn on / turn off time is liable to be sub `1 microsecond if capacitors are not used downstream of the switch.
Current is set to be "about right" at 12 Volts so will vary substantially if used in an automotive context where several volts of variation occurs. Many strips use individual LEDs but some use 3 die per package LEDs with all 3 independent die wired in series. It is possible but not certain that strips with individual LEDs will run somewhat cooler due to a lower concentration of Energy per package.
Lifetime of these LEDs may be better as the series resistor means that they are somewhat more properly driven. I have seen very substantial variations in output of similarly appearing strips. The brightness bears no obvious relationship to LED specifications and a brighter strip may simply reflect a manufacturers 'marketing decision'. You can get a range of LEDs per metre but current drain and number of LEDs are not directly related.
White LEDs are typically have a voltage drop in the 3.0 - 3.5V range at rated current.
Current increase tends to be exponential with voltage and at 4.5V almost any LED would self destruct almost instantly. The "saving grace" (if it can be called that) is that the combination of small batteries and many LEDs means that the batteries are unable to produce more than 'vastly too much' current when the batteries are new. Any light constructed in this manner demonstrates a total lack of concern and/or knowledge by the manufacturer.
Adding even a single common series resistor makes a substantial improvement in voltage/current profile and a resistor per LED would greatly assist current balancing between LEDs.
Added May 2016
Harper commented:
OP is asking about LED bulbs, not strips. Those are commonly made as screw-in replacements for incandescents. Some have a resistor, but many have a switching buck converter which will accept a range of voltages from 12-30V or higher. The LED series voltage is quite close to 12V actual, so if voltage drops much below 12V the buck converter will go to 100% duty cycle and simply pass the voltage through, causing the LEDs to dim rapidly.
My answer addressed LED strips as I noted, which the OP did not ask about, as Harper noted :-).
Harper's comments above are correct where applicable. I have not seen a bulb with a buck converter internally, but no doubt they exist. White LEDs have Vf typically in the range 2.8V - 3.5V. 2.8V is unusual and usually only seen in reasonably modern LEDs or ones operated well under full power. At 12V nominal, 4 LEDs have 12/4 = 3V each available. Allowing a small voltage drop in connectors and wiring 4 LEDs with Vf of 2.8V to 2.9V would be able to be operated at full power. In real world situations with Vin able to be somewhat below to substantially above 12V, 4 LEDs in series will often work but 3 x LEDs in series plus a series resistor is 'safer'. Bulbs may not match strips in configuration, but all 12V LED strips that I have seen use 3 LEDs in series plus a resistor.
Best Answer
White LEDs are blue LEDs with a phosphor that converts some of the blue light into yellow light that mixes with the blue to form white.
The voltage of an LED is related to the energy of the photons in the light and that energy is dependent on the color. To make Blue light requires just over 3V.
The voltage requirement for blue LEDs has been going down in recent years but won't ever reach below 3v. The actual voltage of course also varies with the current, which dictates the brightness. At very low currents (light output) they may be a bit below 3V.
Since you are intending to power the circuit from a 2-cell alkaline battery although it may be slightly greater than 3V when new, it will drop as the battery runs down. To get a good life out of the battery you should design your circuit to work with just 0.9V per cell, i.e. 1.8V for a 2 cell battery or 2.7V for 3-cell.
As Stefan suggests the best way is to use a switching power supply to convert the battery voltage to that needed by the LED. Then you will get the best battery life.