ceramic should work as long as you meet the requirements in the datasheet: 0.1ohm < esr < 5ohm and srf > 1mhz.
Its probably easier to find those properties in a tantalum cap, especially back in 2002 when that datasheet was released.
EDIT: Some more info about LDO stability and why the ESR has to fall in a particular range.
A generic LDO works by comparing the output voltage to an internal voltage reference with an error amplifier and driving a PNP transistor to correct for this error.
The problem comes in when you look at the phase shift and loop gain of this feedback path. The error amplifier and the load being driven both contribute poles to the frequency response of the feedback loop. These poles act as a low pass filter resulting in loop gain decreasing as frequency increases. As we know a pole also introduces a negative phase shift. If this phase shift is allowed to reach -180deg the feedback loop becomes unstable and the LDO will oscillate.
What this means is that every time the error amp tries to compensate for an error the result of its correction is 180deg out of phase, or inverted, consequently the error amp is basically thrown for a loop and begins making the opposite correction that it should be making, resulting in wild instability.
To avoid this situation we need to prevent the phase shift in the feedback loop from ever getting to -180deg, actually we only need to keep it from reaching -180deg within the region that the LDO can generate gain > 1 as the damped response of the system past this point will prevent oscillation. This frequency is defined by the unity-gain point of PNP pass transistor.
The way we prevent this phase shift is by using a capacitor with a ESR in a certain region. The capacitance will shift the pole created by the load but more importantly the ESR will contribute a higher frequency zero. Basically you've added a high pass filter to the feedback loop. The phase shift introduced by the ESR will work to counteract the phase shift introduced at lower frequencies by the poles from the error amp and the load.
The reason that the ESR has to be in a particular range is that if its too low, the zero contributed to the frequency response will be located very high in frequency, above the unity-gain point of the pass transistor. As a result its not effective in making sure the phase shift of the feedback loop doesn't reach -180deg before the unity-gain frequency.
If the ESR is too high, the zero will be very low in frequency. There is another pole in the frequency response created by the parasitics of the pass transistor, if the zero from the capacitor ESR is too low in frequency, this pole will be reached while we still have gain > 1, this will cancel out the effect of the ESR zero and we will likely reach -180deg phase shift before we reach unity gain.
All that said, these problems are indicative of older LDO designs. Many/Most/All new designs include additional internal compensation in the feedback loop which uncouples LDO stability from the ESR specification of the output capacitors.
If I could get a ceramic capacitor at the capacitance of 10uF and within my voltage requirements, which from my initial searches I can, what problems would I experience if I were to change, if any?
Some circuits (like some linear regulators, for example), require a certain minimum ESR from the output capacitor, which could cause the circuit to oscillate when using a ceramic but not with an electrolytic.
In a precision circuit, a ceramic might not be preferred due to microphonics, but in those cases you probably wouldn't want an electrolytic either.
Otherwise, ceramics are generally preferred. They'll have lower ESR, they're not polarized, they need less voltage de-rating, and so on.
Finally, when searching SMD footprint standards, the common packages seem to be 0402, 0603, and 0805, where they increase in physical size respectively, but also power rating, which suggests to me I should use as large of a package as possible
Usually you choose the smallest package you can get away with because you want to fit as much circuit as you can in the smallest footprint.
Also, for ceramics, the larger sizes (1210 and higher) can have reliability issues because they can be cracked if the board flexes.
Best Answer
It depends heavily on the temperature you expect in your application. Recommendations say that 80 % of the rated voltage should never be exceeded, and at 85 °C, you should not apply more than 50 % of the rated voltage. The catalog in this link, for example, has many derating diagrams for various types of tantalum capacitors.