In a digital communication system, is it possible to counteract the aliasing problem by properly tuning the constellation order $M$ and/or the carrier frequency?
Here is my train of thought, please correct me if I'm wrong:
The sampling rate needs to be 2 times the signal bandwidth. This is because we need to cover all the frequencies in which the signal operates. If the signal breaks the Nyquist criterion we'll only get a part of the signal. So if I look at a fix sampling rate and try to tune the constellation order $M$ up and down it won't help, because the signal will still have the same bandwidth. The only thing that will change is the transfer rate $r_b = \log_2(M)/T_s$, where $T_s$ is the sampling rate. Also tinkering around with carrier frequency will only move the signal up or down the frequency. So neither of these solutions will counteract the aliasing problem. The only solution is to somehow reduce the signal bandwidth. I'm thinking of using an RRC filter on the transmitter (to shrink the bandwidth) and then using another RRC filter on the receiver to counteract the ISI.