I had this problem once. Turned out one of the installed extensions tried to "phone home" on each admin-page-load to a server that was no longer maintained - so the request this server had to time out before the actual admin page was rendered.
The extension I used back then was Robogento_RichSnippets.
I found this error by disabling all extensions in codepool "local" in the local.xml file, and suddenly the backend was fast again. After that, I re-enabled the extensions one for one.
This issue thread also details a workaround until the fix is merged into the next Magento release, which is to switch your webserver root to that of the Magento root path, not the /pub subdirectory.
I have verified this works on CE 2.1 (you need to clean cache after this change), however I would personally not recommend using this workaround on a production environment as is less secure.
Best Answer
This issue was also asked about here.
There was an issue opened on github for this.
https://github.com/magento/magento2/issues/5247