As mentioned in Fat32's answer, the integration property can be derived directly from the Fourier transform of the unit step function.
I would like to show you how you can finish your derivation, even though you will also need the Fourier transform of the unit step. The integral
$$\int_{-\infty}^te^{j\omega \tau}d\tau\tag{1}$$
can be written as
$$\int_{-\infty}^{\infty}u(t-\tau)e^{j\omega\tau}d\tau=\int_{-\infty}^{\infty}u(t+\tau)e^{-j\omega\tau}d\tau=\mathcal{F}_{\tau}\{u(t+\tau)\}=e^{j\omega t}U(\omega)\tag{2}$$
where $\mathcal{F}_{\tau}$ denotes the Fourier transform with $\tau$ as the independent time variable (and not $t$), and $U(\omega)$ is the Fourier transform of the unit step function $u(\tau)$.
With
$$U(\omega)=\frac{1}{j\omega}+\pi\delta(\omega)\tag{3}$$
and with $(1)$ and $(2)$ we get
$$\int_{-\infty}^te^{j\omega \tau}d\tau=e^{j\omega t}\left(\frac{1}{j\omega}+\pi\delta(\omega)\right)\tag{4}$$
and the last integral in your question becomes
$$\begin{align}\int_{-\infty}^{t} x(\tau) \mathrm{d} \tau &= \frac{1}{2\pi} \int_{-\infty}^{\infty} X(j\omega) \left(\int_{-\infty}^{t} e^{i\omega \tau} \mathrm{d}\tau \right) \mathrm{d}\omega\\&=\frac{1}{2\pi} \int_{-\infty}^{\infty} X(j\omega)e^{j\omega t}\left(\frac{1}{j\omega}+\pi\delta(\omega)\right)d\omega\\&=\mathcal{F}^{-1}\left\{X(j\omega)\left(\frac{1}{j\omega}+\pi\delta(\omega)\right)\right\}\tag{5}\end{align}$$
from which it follows that
$$\mathcal{F}\left\{\int_{-\infty}^{t} x(\tau) \mathrm{d} \tau\right\}=X(j\omega)\left(\frac{1}{j\omega}+\pi\delta(\omega)\right)=X(j\omega)\frac{1}{j\omega}+\pi X(0)\delta(\omega)\tag{6}$$
What follows is a rather straightforward derivation of the Fourier transform of the unit step $u(t)$. If we accept without any further proof that the (generalized) derivative of the unit step is the Dirac delta impulse
$$u'(t)=\delta(t)\tag{7}$$
we get the following relation for the Fourier transform of $u(t)$:
$$j\omega U(\omega)=1\tag{8}$$
From $(8)$ we can conclude that $U(\omega)$ must have the form
$$U(\omega)=\frac{1}{j\omega}+c\delta(\omega)\tag{9}$$
Multiplying $(9)$ with $j\omega$ gives
$$1+cj\omega\delta(\omega)=1+0\cdot\delta(\omega)=1$$
satisfying $(8)$ (because for any function $f(\omega)$ that is continuous at $\omega=0$ we have $f(\omega)\delta(\omega)=f(0)\delta(\omega)$.)
It only remains to determine the constant $c$ in $(9)$. This can be done by considering the value of the inverse Fourier transform of $U(\omega)$ at $t=0$. Since the inverse Fourier transform gives the average of the left-sided and of the right-sided limit, and since $u(0^-)=0$ and $u(0^+)=1$, we have
$$\frac12=\frac{1}{2\pi}\int_{-\infty}^{\infty}U(\omega)d\omega=\frac{1}{2\pi}\int_{-\infty}^{\infty}\left[\frac{1}{j\omega}+c\delta(\omega)\right]d\omega\tag{10}$$
The Cauchy principal value of the integral of the first term on the right-hand side of $(10)$ vanishes because it is an odd function of $\omega$, so we're left with the second term:
$$\frac12=\frac{1}{2\pi}\int_{-\infty}^{\infty}c\delta(\omega)d\omega=\frac{c}{2\pi}\tag{11}$$
from which $c=\pi$ follows. So from $(9)$ we finally get
$$U(\omega)=\frac{1}{j\omega}+\pi\delta(\omega)\tag{12}$$