RD Connection Broker direct user to specfic RD Session Host

Let me state the objective first. I would like to configure a Remote Desktop Services paradigm such that a Remote Desktop Client is able to connect to an entity, likely an RD Gateway or RD Connection Broker, and be directed to a specific server with the RD Session Host role — based on the user's group membership.

For example, if there exist servers with RD Session host roles called SVR1 and SVR2 and a RD Connection Broker named CB1 with a farm called rd-farm of which SVR1 and SVR2 are members. I'd like to be able to point the user Remote Desktop Client at rd-farm and based on the user's group membership, be directed to SVR1 xor SVR2, but not both.

RD Gateway or RD Connection Broker are both on the table for achieving the objective.

From the investigation I have done I understand it such the RD Connection Broker can use either session load balancing or round-robin DNS like behavior for handing off sessions to Session Hosts. However, I'd like to use a user's group membership to determine to what Session Host they are redirected, not session load balancing or round-robin.

The reason why we would like to achieve this is that we have a fleet of session hosts that are not identical — and as such are not a "farm" in the truest sense of the word. However, we would still like to push out a single client profile (be it from a single RDP icon across the enterprise, a Wyse thin client configuration, etc.) that directs users to the same RD Connection Broker/Gateway and have the user's Active Directory group membership determine to which Session Host they are redirected.

This serverfault Use RD Gateway to direct users to certain term server? doesn't answer the question with the specific qualifiers — group membership, Connection Broker, or with single remote desktop client profile.