If I don't care about computational cost, is there any cons when I put overlap rate really high in STFT?
[EDIT: added a loss on the statistical side] With a traditional windowed version of the STFT, the version $v_N$ with a hop of $N$ samples is essentially the subsampled version, with factor $N$, of the version $v_1$, described by @hotpawn2, the one with $L-1$-sample overlap.
So in a way, a low hop rate essentially contains more or the same kind information, like a signal sampled with a higher frequency. This is especially correct when you compare some hop $h_1=h$ and an integer multiple $h_2=K h$. Let us reformulate: if an STFT works for $h$, it will work for $Kh$, the latter being a form of subsampling (this can be slightly more involved when GCD is not $h$). So you don't loose (much) on transformed coefficients (more the contrary). Moreover, higher redundancy (smaller hops) is generally beneficial for less stationary signals, and higher noise level. If you want to extract information, you have much more flexibility in designing useful inverses.
However, what you loose is the tractability of statistical hypotheses in the redundant case: the larger the overlap, the less valid the hypothesis of uncorrelation between frames, with can be troublesome to derive solid statistical estimators. This already happens in the study of estimated periodograms, and the Welsh version indeed allow the combination of windowing and yields good results with 50% overlap. I lack knowledge about the relevant literature on its performance when overlap increases.
Additional note: when you have performed an analysis, and done some spectrogram processing, there exist other inverses than the ones deduced from the analysis window. From such natural inverses, it is possible to design optimized inverses, for instance better concentrated in time, or in frequency, to limit the spread of time-frequency domain artifacts.
There are situations where a lot of overlap is wanted, but in general, one generally uses Signal Processing to reduce what I'll call the dimension of the data as it proceeds through a system. Having a lot of redundancy persist in a system cuts against the aesthetic of a community that includes scrounging cycles on a dsp. It also uses more Watts.
Lot of overlap also makes analysis of a system harder particularly with assumptions associated with independence.
Increasing the overlap in block-based processing makes it closer to time-invariant processing.
One application of this is reduction of JPEG compression artifacts by re-encoding the image with the block boundaries shifted to all possible pixel positions and by calculating the average image, see:
Aria Nosratinia. Enhancement of JPEG-compressed images by re-application of JPEG. Journal of VLSI Signal Processing 27, 69–79, 2001.
In audio applications, if the processing is prone to give artifacts or if the summation of the block outputs does not perfectly reconstruct the signal, then the frequency of the overlapping windows might be audible, and it can be made inaudible by starting a block at every sample. Even more extreme would be to start the blocks at sub-sample steps.
Except for the computational cost, high overlap seems to me only good.