The significance is s p i n
(The first part of this answer assumes familiarity with complex "spin"; supplementary explanations are referenced at bottom, and should be consulted before reading the main body if one's unfamiliar.)
Spectral asymmetry is spin asymmetry. Negatives dominating positives guarantees net-clockwise traversal about the axis of evolution (which is also the axis of revolution), and vice versa.
One can have all the ingredients, but the missing piece can be the right perspective. The key is to recognize that spin is a separate degree of freedom.
The Fourier transform collapses the time axis and only speaks of frequencies. Its ability to directly represent variation, in that behavior is read off directly from coefficients faithfully, does not extend to frequencies or amplitudes that change over time. More generally, we have time-frequency, whose coefficients directly represent frequency and amplitude over time - in best case exactly, in worst case bounded by Heisenberg's uncertainty. Within it, positives are negatives are both more distinct and more natural:
We have what can be described as pulses - bursts of oscillations - and a usual spectrogram, except also showing negatives, and this time the intensities aren't mirrored as for real-valued signals. Each half of the spectrogram responds to unique variation.
Indeed, lack of mirroring guarantees the signal isn't real-valued. This may be a surprise - per conventional wisdom of STFT modulus discarding phase, one may figure we can mirror magnitude but have phase be not Hermitian-symmetric. But we can't! To do so would mean we have counter-clockwise and clockwise traversal over same time instants, which by definition cancel. The only alternatives are complete sign reversal, which cancels to zero, or aligned rotation, which doubles up either on positives or negatives. Indeed, STFT isn't FT, and its modulus is strongly invertible (within global phase shift) - if such mirroring were possible, much more info would be lost.
More yet, CWT says positives and negatives are infinitely apart. In an important sense, CWT is the one with fixed resolution, not STFT - and follows ratio-based (logarithmic) decomposition, more natural for many structures. If we try to cross from negatives to positives, with linear frequency growth, we see:
The traversal stops, momentarily. This is required, since we're crossing the DC bin, which is of course the constant bin with zero derivative - and it further shows the fundamental distinction: no amount of speeding up or slowing down, or changing of intensity, results in changed direction of rotation.
The morale is simple: spin encodes irreducible variation that is inexpressible in terms of frequency - rate of oscillation - or amplitude - intensity of oscillation. As a more familiar analogy, it's like using a microphone that only records volume, without frequency: no matter how we do it, volume is just volume - an entire degree of freedom is missing.
So what's it all mean? What of the "real world"?
The real world:
Source: Vsauce
The world orbits the sun, the sun orbits Sagittarius A* - in turn, our Earth traverses a helix about the sun's orbit. If we take January 1 to be 0 degrees with respect to the sun and start recording, then by December 31, the Earth will traverse 358.77 degrees counterclockwise about the sun with a mean radius of 149,600,000 km, and 7,233,408,000 km with respect to Saggitarius A*. The Discrete Fourier Transform of this path peaks at $+3.16 \times 10^{-8}\ \text{Hz}$, with amplitude of around 149,600,000 km, and no negative frequencies.
If aliens hand us a graph of the complete Fourier transform of Earth's orbit (and cite relativity for how they saw future paths), and the graph shows a peak at a negative frequency, we'll ask if they have room aboard.
If we want to compare slinkies, or springs,
Source: sparktec, e-Bay
If the spring on left is meant to be inserted from the wide end, then its Fourier transform peaks negative (clockwise), else positive. If we want coiling with even spacing, we can check if there's multiple peaks close in amplitude, as with springs on right. If we want windings to have the same radius, or compare spacings between windings, we can look at their spectrogram, which is a locally weighted unfolding of the Fourier transform along time, that'll reveal the instantaneous radius and rate of winding over the length of the spring.
If we want to measure the performance of an all-terrain vehicle (ATV),
Source: carbuzz.com
the 2D Fourier transform (rather, 3D spectrogram) of a recording of a point on the wheel over time, and over distance the ATV travels on muddy roads, will reveal the efficiency with which the wheels' rotations result in actual motion as opposed to fighting the mud (distance vs time amplitude), and we can compare performance for different wheel speeds (frequency), and when the car is going forward vs backwards (negative vs positive frequency).
The list goes on. Now, some may object. Yet, the "metaphysical status" of complex numbers bears no difference. The positive and negative frequencies of the Fourier transform meaningfully and usefully describe physical phenomena, and each is distinct and necessary for a complete description.
I still don't buy it! Where's real imaginary numbers?
Fine. Actually, in your ears:
Source: Britannica
The Joint Time-Frequency Scattering transform shares bioplausibility with STRF (Spectro-Temporal Receptive Fields), where close correspondence with auditory responses of animals and humans is shown by neurophysiological and behavioral evidence (V. Lostanlen, et al, D. Klein, et al, F. Theunissen, et al). Methods include comparing direct measurements of auditory cortex responses with the model's coefficients to a range of stimuli, and correlating perceptual recognition of human listeners of musical sounds with nearest neighbor search directly on coefficients. T. Chi, et al estimate $Q_2 \approx 2$ (one of key transform parameters) in humans.
It's a fundamentally complex transform. It applies complex 2D wavelets upon the modulus of complex wavelet transform to discriminate rises and falls in frequency. The input is standard real-valued audio, but its projection to complex space is necessary to obtain the discriminatory, invariance, and stability properties of the transform that are responsible for the notable success of its features fed straight to a linear classifier on audio tasks. The linear classifier is the final stage of nearly all modern machine learning methods; success of fed features indicates that the relevant variability is distributed in such a way in the transformed space that distinct classes are grouped left and right (for example) and can be picked out by naked eye - or in short, strong explanatory power.
Simply put, there's strong evidence for the ear doing equivalently complex-valued processing. As for where exactly it happens, physically, I'm no cochlea expert at all.
What's required, physically, for distinct use of negative frequencies and complex numbers, is three degrees of freedom - with two of said degrees evolving in terms of the third, while forming a pair for which "angle" is a valid parameter. This is suggestive of rotation, and while valid rotational interpretation directly follows, something physically rotating is not required - the rotation can instead take place in the resulting projection, for example electric and magnetic components of an EM wave. Of course, physical circular behavior (not necessarily over time) is ideal.
No matter what you say, imaginary isn't real
Is negative real? Can you hold negative two apples?
"I can have debt, that's negative money" - no, that's what the banker says to remove your positive money. Indeed, that's what "negative" means - a quantity such that, when combined with a positive of equal size, cancels.
An imaginary is a quantity such that, when squared and combined with a real squared, cancels.
Imaginaries "exist" as much as reals do. They don't, or they do. The name is what I consider to be the greatest misnomer in all of mathematics. And what I did above isn't semantic tricks - it's precisely how many mathematical concepts are defined - in terms of properties. The unit impulse is a distribution such that, when integrated over its entire domain, is unity. And I consider it to be a lot more "unreal" than imaginaries, yet it forms the basis of real-world signal processing.
But what's it mean for my data?
It depends.
If the data is provided in complex form, odds are, it was fed through stages of processing to end up that way, and said processing determines the interpretation. I/Q data, for example, can be used to efficiently transmit two independent signals, or one and describe its amplitude and phase - positive and negative frequencies have no meaning here.
Worse yet, "positives" can lose their original meaning entirely - the Fourier transform is fundamentally a numeric manipulation, it need not come with any "meaning" attached. This can happen with a frequency shift to "baseband" (f=0), for example, that's done for engineering purposes. Then the interpretation could be efficient compression, sparse encoding, or other.
Either data must be measured as complex as in above examples, or the processing of real-valued data must involve operations that distinguish between positive and negative frequencies, as with JTFS.
Is "negative frequency" fundamentally about frequency? Or is it about rotation, or time evolution? Mathematically?
Covered in this article.
Notes
- The intro GIF is JTFS 2D wavelets! It also provides the explanation that was "assumed" at top of this article.
- The Fourier coefficient results of my Earth-sun example ignore the traversal about Saggitarius A*; instead, the "axis of evolution" is time. It could be made with respect to the traversal instead, with Earth's orbit projected into the 2D plane perpendicular to the sun's velocity.