I'm not aware of literature defining this in general, although for some special cases (e.g. PSD, as commented in the question), there may be some convention/definition generally accepted. (If someone is, please do enlighten us.)
But I'd share a concrete example here, which may help to shed light on this: Suppose we have a signal $x(t)=\cos(2\pi t)+2\cos(4\pi t)$, representing the output voltage of an electric circuit at different time instant. So the unit of $x(t)$ is just Volt.
Since $x(t)$ is periodic with fundamental period $T=1$, it has a Fourier series representation, i.e.
$$x(t) = \sum_{k=-\infty}^{\infty} a_k e^{j2\pi kt}$$
For this simple $x(t)$, it's easily verified that $a_{-1} = a_{1}=\frac{1}2$, $a_2=a_{-2}=1$, and $a_k=0$ for all other values of $k$, and
$$x(t)=a_{-2} e^{-j4\pi t} + a_{-1} e^{-j2\pi t} + a_1 e^{j2\pi t} + a_2 e^{j4\pi t}.$$
So, what should the unit of $a_k$ be?
It may help to look at it this way: The Fourier series simply decomposes the time function $x(t)$ into four constituent time functions, e.g. $e^{-j4\pi t}, e^{-j2\pi t},$ etc, with $a_k$'s being their respective scaling constants. In this regard,
A natural & simple interpretation may be to have each of the constituent time functions $e^{j2\pi kt}$ assume unit of Volt, and to let $a_k$'s be unit-less. This way we're consistent physically.
Remarks:
Note that $a_k$'s are not percentage, as the OP also observed, as they can be negative or even non-real. Nonetheless, they do represent weightings of the constituent functions, and hence are strongly correlated with the concept of percentage or proportion.
Fourier Transform may, of course, be viewed as the limiting form of Fourier series, and hence may also be viewed as unit-less.