Zabbix graph of item from different hosts

You can create a custom graph that pulls items from multiple hosts. The graph however will be associated with a host, in which case you could create a phantom host which you can associate the graph with. Configuration -> Hosts -> Graphs (in the host you want the graph to be associated with). When you add your Graph items you can selected the host from which each item comes from.

Alternatively there are aggregate hosts available as well. These allow for the accumulation of items across all hosts in a host group.