Based on the existing answers, which opened my eyes for what's going on here, I would like to present yet another very simple expression for the solution, which is just slightly different from the one in AlexTP's answer (and which turned out to be equivalent to the one given in Jason R's answer, as shown below in the EDIT-part).
[EDIT: now that AlexTP has edited his answer, our expressions for the PDF are identical; so all three answers finally agree with each other].
Let the complex random variable $Z=X+jY$ be defined as
$$Z=\rho e^{j\theta}\tag{1}$$
where the radius $\rho$ is deterministic and given, whereas the angle $\theta$ is random and uniformly distributed on $[0,2\pi)$. I state without further proof that $Z$ is circularly symmetrical, from which it follows that its probability density function (PDF) must satisfy
$$f_Z(z)=f_Z(x+jy)=f_Z(r),\qquad\textrm{with}\quad r=\sqrt{x^2+y^2}\tag{2}$$
i.e., it can be written as a function of the radius (magnitude) $r$.
Since the PDF must be zero everywhere except for $r=\rho$, and since it must integrate to unity (when integrated over the 2-dimensional plane), the only possible PDF is
$$f_Z(r)=\frac{1}{2\pi}\delta(r-\rho)\tag{3}$$
It can be shown that $(3)$ leads to the correct marginal densities for the random variables $X$ and $Y$.
EDIT:
After some very useful discussion in the comments it appears that we've managed to agree on one solution to the problem. I will show in the following that the unassuming formula $(3)$ is actually equivalent to the more involved looking formula in Jason R's answer. Note that I use $r$ for the magnitude (radius) of the complex RV $Z$, whereas in Jason's answer $r$ denotes the real part of $Z$. I will use $x$ and $y$ for the real and imaginary parts, respectively. Here we go:
$$f_Z(r)=\frac{1}{2\pi}\delta(r-\rho)=\frac{1}{2\pi}\delta\left(\sqrt{x^2+y^2}-\rho\right)\tag{4}$$
We know that $\delta\big(g(x)\big)$ is given by
$$\delta\big(g(x)\big)=\sum_i\frac{\delta(x-x_i)}{|g'(x_i)|}\tag{5}$$
where $x_i$ are the (simple) roots of $g(x)$. We have
$$g(x)=\sqrt{x^2+y^2}-\rho\quad\textrm{and}\quad g'(x)=\frac{x}{\sqrt{x^2+y^2}}=\frac{x}{r}\tag{6}$$
The two roots $x_i$ are
$$x_{1,2}=\pm\sqrt{\rho^2-y^2}\tag{7}$$
Consequently,
$$|g'(x_1)|=|g'(x_2)|=\frac{\sqrt{\rho^2-y^2}}{\rho}=\sqrt{1-\left(\frac{y}{\rho}\right)^2}\tag{8}$$
With $(5)$-$(8)$, Eq. $(4)$ can be written as
$$f_{X,Y}(x,y)=\frac{1}{2\pi\sqrt{1-\left(\frac{y}{\rho}\right)^2}}\left[\delta\left(x-\sqrt{\rho^2-y^2}\right)+\delta\left(x+\sqrt{\rho^2-y^2}\right)\right]\tag{9}$$
For $\rho=1$, Eq. $(9)$ is identical to the expression given in Jason R's answer.
I think we can now agree that Eq. $(3)$ is a correct (and very simple) expression for the PDF of the complex RV $Z=\rho e^{j\theta}$ with deterministic $\rho$ and uniformly distributed $\theta$.