There are three options I know of. One is to terminate one of the ports with 50ohms and take 2-port measurements.
I think it will reduce the math involved if you terminate each port with a load that matches its output impedance. For example if you terminate port 2 with a matched load of Z2, then measure the S-parameters between ports 1 and 3 with a 2-port network analyzer, you will get the correct S13 and S31 because there will be no signal incoming to port 2.
Unfortunately it's not likely you'd be able to make a perfectly matched load for port 2 without something like laser-trimmed resistors.
The second option is to take a 3-port measurement.
If you have the equipment to do a 3-port measurement, that sounds like by far the most straightforward way to solve this.
The problem is, the two output traces are about 10-20 times the width of a 50ohm line, with spacing near the minimum allowed. If I connect to the output ports with a wide line or taper, I'll have moding and coupling errors. If I connect to them with a 50ohm line, I'll get errors due to the large step in width.
If you can, I'd suggest to use lines matched to the device's output ports to connect to the probe pads. Then you will calibrate your network analyzer (VNA) at the probe's reference planes. The VNA will have built in the capability to transform the port impedances, which will take into account the calibrations and make it as if you had measured with a VNA with the desired port impedances.
I'm considering placing two identical splitters back to back and taking a 2-port measurement.
I don't think this will be effective if done the way you show it in your drawing. You'll have problems if you can't perfectly match the phase delay in the lines connecting the port 2's and the port 3's, for example.
Better would be to, for example, terminate port 2 on each of the devices, and connect the port 3's. And measure the 2-port parameters between the port 1's. Then you'll get a measurement of \$S_{31}S_{13}\$ from which you can estimate the actual actual \$S_{31}\$ by assuming the two devices are identical. Again, imperfections on the matching of the port 2 termination will contribute errors.
If you have -27 dB S11, then the match is definitely not your range problem! However, SAW filters often have a good bit of loss, so if there is no amp between it and the antenna, I might be a bit suspicious of that.
Best Answer
Connect the antenna port to the VNA port, measure S11.
You will want to ensure that there are no RF reflectors within sight of the antenna. This could be done by pointing it at the sky, out of a window, or at an RF absorber. Any signal reflected back to the antenna will appear as a returned signal at the antenna port, and so alter your true S11 measurement.