Put the magnetics close to the phy. Put the phy close to the mac. Run the "connector side" of the magnetics a long distance-- after all, isn't that what it's designed for, running long distances? Running the RGMII or GMII signals a long distance, and board to board, is not impossible but far from ideal or easy.

I do recommend shielding the cable/connections from the magnetics to the connector if you're running them any reasonable distance. This is so you don't pick up too much emi from inside the chassis, or taking emi from outside the chassis and bring it inside.

I should also say that I've done this successfully, several times, for several different products that are in volume production.

The answers to the previous question you referenced, give some strategies but do not ground and/or not light the conditions in those that strategies are useful. Therefore, the short answer to your question: it depends.

The long answer is the following:

Scenario A: you trace a two-layer PCB

• On a two-layer PCB, it is too difficult (or simply impossible) to route impedance matched pairs, therefore place the phy, mag, and jack as close as possible to make that traces short as possible but also keeping wires lengths matched within pairs at least.

  

Scenario B: you trace a four or more layer PCB

On an at least four-layer PCB, it is simple to organize the corresponding reference planes and there are two sub-scenarios here:

• 1) If you (can) organize AGND reference plane only, than only phy-mag pairs can be traced impedance matched, therefore you must keep the mag-rj45 distance as short as possible. (Keeping the lengths matched is also mandatory here.)

  

• 2) If you (can) organize both AGND between phy-mag traces and (let's call it so) MGND between mag-rj45 traces, than you can trace all the pairs impedance&lengths matched. But you must be aware that each mag-rj45 path must have its separate reference plane, rather than AGND that can be shared.

  

  Some tips on how to do MGND is shown below.

  

Now, on your sub-questions:

Which of the two, remote the connector or remote the PHY, is “correct”/ easier to implement for maintaining signal integrity and minimizing EMI?

IMO, Scenario B1 is preferred, because tracing many pairs (including many pairs of many phys) with respect to one reference is simpler than what is needed to do in other cases.

What is the maximum length that is possible to remote the PHY or the connector?

Without a reference, up to one inch limit is recommended. With a reference, it can be much longer.

Do I have to run the long lengths off the board?

It depends on your construction. Running on a PCB, use at least the approaches shown above.

How does a 48 or 96 port gigabit switch run their signals while maintaining signal integrity?

They use many approaches, mostly including (but not limited to) shown above.

Are there any definite specs on how to proceed?

Maybe, but i think they all are case dependent.

Good luck.