Debian – Uninstall package on Debian 7

I am trying to uninstall apache2 on my Debian 7 server.

First I stop the apache2 service like this:

sudo service apache2 stop

Then I did

sudo apt-get --purge remove apache2

The response I got was:

0 upgraded, 0 newly installed, 1 to remove and 4 not upgraded. After
this operation, 29.7 kB disk space will be freed. Do you want to
continue [Y/n]? Y (Reading database … 43648 files and directories
currently installed.) Removing apache2 … mark@mw-webdev2:/etc$

So I figured it would be uninstalled, but then if I run:

sudo service apache2 start

I get this:

Starting web server: apache2.

I really can't understand what is happening here. Why does it say that it's uninstalled but it's still installed and running on my server?