A point on the S-plane (where $s=\sigma+j\omega$) represents a signal with a given frequency (given by the imaginary component) and which either decays, increases or stays stable (depending on the value on the real component).
Doing the maths, by converting $e^{-st}$ to a cosine and sine pair, I can see that points the left hand side of the plane describe signals that increase infinitely and points in the right hand side of the plane describe points that decrease to infinity.
Given this, why is it true that having poles of a transfer function (the frequency values which make the gain of the system infinite), lying in the left hand side of the S-plane (the side which makes signals increase infinity), makes a system stable ?