I'd like to add a response as I just computed some stuff, which hopefully is correct, but everything adds up, so I am hopeful!
I assume a system response $H(e^{j\omega}) = e^{-j\phi(\omega)}$, so a generic allpass. Furthermore some generic input signal spectrum $X(e^{j\omega }) = \sum_{k=-\infty}^{\infty}x(k)e^{-j\omega k}$ and the corresponding output spectrum $ Y(e^{j\omega}) = X(e^{j\omega}) H(e^{j\omega})$.
We are interested in the output signal $y(n)$ and how it relates back to $x(n)$. First, I will not assume a special form of the phase response. Generally, we obtain
$y(n) = \frac{1}{2\pi} \int_{-\pi}^{\pi} Y(e^{j\omega})e^{j\omega n}d\omega = \frac{1}{2\pi} \int_{-\pi}^{\pi} e^{-j\phi(\omega)} \sum_{k=-\infty}^{\infty}x(k)e^{-j\omega k} e^{j\omega n}d\omega = \frac{1}{2\pi}\sum_{k=-\infty}^{\infty}x(k)\int_{-\pi}^{\pi} e^{-j\phi(\omega)} e^{j\omega (n-k)}d\omega$
Because $\phi(\omega)$ is periodic with period $2\pi$, we can expand $e^{-j\phi(\omega)}$ into a Fourier series, and actually, we see the computation of some fourier coeffients in the final integral.
For a function $f$ with a period of $2\pi$ and the complex fourier series, we have the general formular
$ c_n = \frac{1}{2\pi}\int_{-\pi}^{\pi}f(\omega)e^{-j\omega n}d\omega$ for the fourier coefficients. I assume $f$ is such, that the integral exists.
Now we obtain further
$ \frac{1}{2\pi}\int_{-\pi}^{\pi} e^{-j\phi(\omega)} e^{j\omega (n-k)}d\omega = \overline{\frac{1}{2\pi}\int_{-\pi}^{\pi} e^{j\phi(\omega)} e^{-j\omega (n-k)}d\omega} = \overline{c_{n-k}(e^{j\phi(\omega)})}$
where $c_{n-k}(e^{j\phi(\omega)})$ denotes the fourier coefficients of $e^{j\phi (\omega)}$.
Now, using the relation $c_n(\overline{f}) = \overline{c_{-n}(f)}$, where $\overline{\cdot}$ denotes the complex conjugate, we obtain
$\overline{c_{n-k}(e^{j\phi(\omega)})} = \overline{c_{-(-n+k)}(e^{j\phi(\omega)})} = c_{k-n}(\overline{e^{j\phi(\omega)}}) = c_{k-n}(e^{-j\phi(\omega)})$
It follows
$ y(n) = \sum_{k=-\infty}^{\infty}x(k)c_{k-n}(e^{-j\phi(\omega)}).$
So we obtain $y(n)$ by convolving the input signal with the time reversed fourier coefficients of the system's transfer function.
Now, this equation yields the well known result for a linear phase response (try it out, the fourier coefficients are obvious). However, if we have $\phi(\omega) = r\omega$ with real, noninteger $r$, we can compute, that this phase response indeed phase shifts the input signal by $r$ samples:
the fourier coefficients of $e^{-jr \omega}$ are
$ c_n(e^{-j r\omega}) = (-1)^n \frac{sin(\pi r)}{\pi (n+r)}$.
Pluggin this into the previous equation, we get
$y(n) = \sum_{k=-\infty}^{\infty} x(k) c_{k-n}(e^{-j r\omega}) = \sum_{k=-\infty}^{\infty} x(k) (-1)^{k-n} \frac{sin(\pi r)}{\pi (k-n + r)}$
Using $ (-1)^{k-n}sin(\pi r) = sin(\pi r + \pi (k-n))$, we can actually see, that this formular is just shannon's interpolation formular with sampling period $T=1$ and some index changes. Therefore, if you filter an input signal with the system $H(e^{j\omega}) = e^{-j r \omega}$, it delays the input by an amount of $r$ samples, i.e., it is as if the input signal is interpolated using shannongs formular, shifted (delayed) in continous time domain by $r$, and then resampled with a period of $T=1$.
This is what some other people have said, and what you can find elsewhere on the internet, however, I have never seen it actually being calculated. It is missing from typical signal processing tables.
I hope I did not make a mistake :D