I'm dealing with an echo signal from a hybrid. An echo path includes DAC, the hybrid, ADC and the line infrastructure. I can see, that after using a digital linear echo-canceller the residual echo signal is still significant and I suspect that echo-path has additional non-linear components. Now I want to estimate, how much of the incoming signal is an actual echo and not a noise, and I want to do it before actually implementing or inferring any specific non-linear function (e.g. without assumptions regarding the order of Volterra series).
I've found the ITU-T O.42 recommendation, which suggests using the 4-tone intermodulation method to measure nonlinear distortion impairments on analogue circuits. But it doesn't suit me, since my echo path includes the DAC.
So is there a way to measure or estimate the level of the non-linearity in my echo path? I would highly appreciate any references. Also, if this question is more related to electronics, please feel free to migrate it to the corresponding site.
UPDATE:
Definition of non-linearity: based on the source, a non-linearity for an echo signal is anything that cannot be modeled with a linear filter: a dc component, a long tail and truly non-linear dependencies. So the question becomes: is there a way to measure or estimate the level of those components compared to noise? The peculiarity here is that both a dc component and a long tail are actually linear in their nature.
Signal measurements: Following are the data that I got by changing the power of transmitted signal (from 1 to 6).
Power spectral density plots (regular and normalized), where frequencies are limited by a sampling rate:


Left: echo mean z mean
and variance z var
and residual echo mean e mean
and variance e var
for a regular (random) transmitted signal (using some arbitrary length of a linear filter). Right: echo mean and variance and residual echo mean and variance (using filter weights from training on the regular signal) for a constant transmitted symbol.


Observations:
The PSD plots look identical, except for unclear shift of a plot for the lowest power level (1).
Mean and variance plots do not resemble any obvious non-linearity, which would have shown as a power law dependency everywhere. Based on increased
e mean
for a constant transmitted symbol, there is a tail in the echo.What puzzles me the most is a linear growth of a residual echo variance, which I cannot explain.
So the original question is still relevant. Additionally, can I actually use obtained plots to estimate the echo non-linearity and if so, how should I do it?