$collection->count() loads the collection and returns the number of products matching the select associated to the collection.
I think you are looking for $collection->getSize(). This will get you the total number of products matching the select, but ignores the limit.
Also getSize does not load the collection, so it's faster.
Best Answer
This is one way to hide limiter and count from listing Page, there can be others as well
Update your extended toolbar.phtml file and Find it at your extended theme path or if not then copy from vendor
To hide limiter and count from listing Page comment these lines of code
( added // before "include", this is how we comment php code)
Keep cache disabled and run following commands if needed
Tested and it works, should help you out as well