Electronic – Using Single Ended Output with Differential Input by Grounding one Input

On reflection, the answer is to heed the advice "any time you can't find an opamp with two critical characteristics, use two opamps". A voltage feedback amplifier like the LMH6657 configured as a unity gain differential amp, followed by a high slew rate current feedback amplifier to produce the required voltage swing can together produce the result I need.

...as far as i have read about them (also their data sheets), if an ADC has both single and differential ended inputs, we can use it as a single ended input ADC OR we can use it as a differential ended input ADC. Which means we cannot use it as both single and differential input at the same time.

This is not always true. For example, I have used ADS1015 on a couple of projects recently. On this chip, whenever you switch the channel being read you also have the option to switch between single-ended and differential measurement. (This is not an endorsement of this chip for your project. Just an example of a chip that doesn't have the limitation you thought was universal)

Furthermore, even if you had a device that had to be configured as single-ended or differential for all channels at the same time, nothing prevents you from using ground as one of the inputs to a differential channel. So you could just configure it as differential and move on with your design. The only thing you'd lose is the opportunity to use the 4th input pin for some other purpose.

Another option, if you plan to use external signal conditioning, you can do differential to single-ended conversion in the signal conditioning circuit, and your ADC will never know the signals are anything but single-ended. This essentially makes the amplifiers shown in your diagrams to be external devices rather than internal to the ADC chip (and add some filtering in their feedback networks to reduce noise).