You have the right idea for a basic unregulated supply. A transformer, four diodes, and as large a cap as you can manage will serve well enough for a lot of purposes, but isn't appropriate for all.
There are two main problems with such a unregulated supply. First, the voltage is not known well. Even with ideal components, so that the AC coming out of the transformer is a fixed fraction of the AC going in, you still have variations in that AC input. Wall power can vary by around 10%, and that's without considering unusual situations like brownouts. Then you have the impedance of the transformer. As you draw current, the output voltage of the transformer will drop.
Second, there will be ripple, possibly quite significant ripple. That cap is charged twice per line cycle, or every 8.3 ms. In between the line peaks, the cap is supplying the output current. This decreases the voltage on the cap. The only way to decrease this ripple in this type of design is to use a bigger cap or draw less current.
And don't even think about power factor. The power factor a full wave bridge presents to the AC line is "not nice". The transformer will smooth that out a little, but you will still have a crappy power factor regardless of what the load does. Fortunately, power factor is of little concern for something like a bench supply. Your refrigerator probably treats the power line worse than your bench supply ever will. Don't worry about it.
Some things you can't do with this supply is run a anything that has a tight voltage tolerance. For example, many digital devices will want 5.0 V or 3.3 V ± 10%. You're supply won't be able to do that. What you should probably do is aim for 7.5 V lowest possible output under load, with the lowest valid line voltage in, and at the bottom of the ripples. If you can guarantee that, you can use a 7805 regulator to make a nice and clean 5 V suitable for digital circuits.
Note that after you account for all the reasons the supply voltage might drop, that the nominal output voltage may well be several volts higher. If so, keep the dissipation of the regulator in mind. For example, if the nominal supply output is 9 V, then the regulator will drop 4 V. That 4 V times the current is the power that will heat the regulator. For example, if this is powering a digital circuit that draws 200 mA, then the dissipation in the regulator will be 4V x 200mA = 800mW. That's will get a 7805 in free air quite hot, but it will probably still be OK. Fortunately, 7805 regulators contain a thermal shutdown circuit, so they will just shut off the output for a while instead of allowing themselves to get cooked.
Unless you have specific requirements of isolation levels and such, any transformer will do. For almost all applications that dont include RF the deciding factors are availability, cost, and size, usually in that order.
Make sure that the one you get has its inputs at 220VAC, and a secondary of about 19-0-19 with sufficient current rating for what you need. The 19 comes from the fact that you need atleast 25.2 on the output to give the LM3x7 room to regulate, and after rectification you end up with 1.4 times the secondary AC rating. Best to also leave a little bit of margin on top of that. Don't go too high, though, or you risk inviting a heating problem at the regulator.
Best Answer
It's a linear supply, so no EMI is created by the regulator.
Unrelated to EMI, but for surges-your regulator is only rated for 40V, that's very close to the line with a light load, depending on transformer regulation etc.
Consider putting a few hundred ohms in series with 10n or so across each of the four diodes in the bridge rectifier. Or use a soft-recovery bridge. This could be important for low-level or audio work because the diode recovery causes ringing that sounds like a 100Hz or 120Hz buzz.