Aptitude can help you when you initially install the package:
aptitude install "zlib1g-dev&M"
Or, after your have installed the package:
aptitude markauto "zlib1g"
Edit: If you do not have aptitude, you can use
apt-mark auto zlib1g-dev
Why are you installing Bugzilla manually? ;-)
I don't have an Ubuntu box to check from, but there's a Bugzilla package in Debian (bugzilla3), so I'm guessing it's available, even if you need to enable the Universe. Have you tried using that? Also, the fact that it exists out there tells me that all required Perl modules are packaged for Ubuntu, although again, you might have to enable the Universe repository.
Trying to mix Distribution provided perl modules with CPAN can get kinda hairy, if you're not careful. I have a pretty strong preference for keeping them completely separate for all but the most simple cases (by separate, I mean I install a completely new and separate Perl and CPAN installation if I need crazy stuff that's not available via APT repositories, and then use that separate installation just for the application(s) I installed it for).
If I were you, I'd start by getting rid of all the CPAN installed stuff, and try:
sudo aptitude install bugzilla3
See if that does the trick for you.
Best Answer
You can try with
This will ask again the configuration questions about the package. It may ask you to reconfigure related packages as well.