Let $H(s)$ be a transfer function of the form
$$H(s) = \frac{1}{s-p}$$
where $p$, which is a pole of $H(s)$, can be written as a complex number $a+jb$. Taking the inverse Laplace transform of $H(s)$ gives the corresponding impulse response $h(t)$ (that is, the output of your system when given $\delta(t)$ as input). Noting $\mathcal{L}^{-1}$ the inverse Laplace transform, we have
$$h(t) = \mathcal{L}^{-1}\{H(s)\} = e^{pt} = e^{at}e^{jbt}.$$
Now let's look at what this impulse response looks like. The term $e^{at}$ is a simple exponential which will be either decaying (if $a < 0$) or growing (if $a$ > 0) with time. The term $e^{jbt}$ will be responsible for oscillations in the output of your system (remember that $e^{jbt} = \cos(bt) + j\sin(bt)$). From this, you can infer the stability of your system and understand why we need poles in the left-hand side of the $s$-plane (i.e. we need $a < 0$) for the system to be stable.
Often, the numerator and the denominator of your transfer function have real coefficients, and in this case poles appear in complex conjugate pairs. You could for example have
$$h(t) = e^{at}(e^{jbt} + e^{-jbt}) = 2e^{at}\cos{bt}.$$
I like to keep this picture in mind (taken from here) which greatly summarizes this.
For more complex transfer function, partial fraction decomposition can be used to go back to simple cases as presented here.