You want the negative end of the 5V supply (let's call it ground) connected to your MOSFET source, not the drain.
To turn on, you need to apply a voltage between gate and ground, 3V should work okay for most small MOSFETS. You would need to connect the negative side of your 3V to ground (i.e both 3V and 5V negatives tied together) and positive to the MOSFET gate.
Alternatively you can just apply 5V to the gate (the same 5V used to drive the motor)
Also, if you are just touching the voltage to the gate (i.e. not driving with uC or something) then you will need a pulldown resistor between gate and ground to make sure it turns off when power is removed. Something like 10k will do (if you don't have that value, try anything between say, 1k and 100k)
As Faken mentions, a reverse biased diode across the motor is needed to prevent the voltage spike on switch off destroying the transistor. Connect e.g. a 1N4002, cathode to V+, anode to MOSFET drain.
For clarity, here is an example circuit:
Your motor is driven from 5V, so you just put your supply where the 9V supply is. To drive you apply a voltage (above MOSFET turn on) to the gate (FROM MCU) Check your datasheet for the turn on voltage, but 3V or 5V should probably work fine (note with part number shown more than 3V will be needed for reasonable turn on)
Under electrical characteristics in the datasheet, you are looking for a graph like the one shown below. Along the bottom is the drain-source voltage, along the vertical axis is the drain-source current, and each line is a different gate voltage.
Your drain source voltage is 5V. We can see if we apply 3V to the gate we will only get around 30mA, as the MOSFET is not turned on fully. Raising the gate voltage to 4V we will get around 400mA, which should be enough to drive a small motor. Note that the maximum drain source current is only 200mA for this part, so you need to make sure your motors current rating is less than this. If you need more than this then the part shown is no good.
If you give details on the MOSFET and motor used (part numbers, datasheets) more detail can be given.
Best Answer
You need to use a MOSFET with a logic level gate. The MOSFET you are using is only slightly 'on' with 5V on the gate. It's not guaranteed to conduct more than 0.25mA at 5V Vgs.
Get one that has a guaranteed Rds(on) at 4.5V gate-to-source voltage. For a motor with a run current of 150mA, maybe a few amperes at start-up, so < 100m\$\Omega\$ should be okay.
For example, a NDP6020P which is guaranteed to have less than 80m\$\Omega\$ with 4.5V drive even when very hot (125°C) and is more likely to be ~40m\$\Omega\$ at room temperature.
Alternately you could re-design your circuit to provide a -5V gate drive wrt ground (-10V relative to the source) but even so that (high voltage) MOSFET you have isn't all that suitable with an Rds(on) that is about 10x higher. What it's good for is high voltage (-200V rating).