I am studying a 1D beamforming for wide-band signals, so that applying only phase weights to each individual antenna would steer the beam for the central frequency. For other frequencies the steering would not be the desired one. I understand the optimum way to apply the beamforming would be to apply delay weights instead, meaning a different phase is correctly applied to each frequency.
Exactly. That's why as far as I'm aware, all wideband systems that do MIMO are OFDM systems: you do the MIMO / beamforming per subcarrier than, and that's narrowband enough so that one value suffices.
Imagine I apply first a phase shift to each channel. This means this phase shift is only valid for the central frequency. If I want then to apply a correction for all the frequencies, could I apply a 'delta delay' to each channel?
You need to be as granular (actually, probably twice) as your channel is frequency selective. So, if you could build an $N$-tap equalizer to flatten your SISO channel frequency response (to convert your channel impulse response to a singular impulse), you'll need at least $N$ taps per antenna to support your beamforming (again, probably more).
The math for this exists, it's just not very commonly done, because it's a) computationally intense, and as far as I understand (never done the math myself) b) not much better than simply dividing your wideband channels into $N$ narrowband channels and then going at them with independent classical, single-coefficient-per-antenna beamforming, and commercially pretty importantly, c) everyone uses OFDM already (even if that brings tears to the eyes of people who wrote excellent synchronizers and equalizers for the pre-OFDM cellular era).
You'll find wideband beam former in the audio domain, and specific radar application. It's not trivial to define what the right metric is: Is it narrowness of the beam at the "worst" frequency? Or is it quadratic deviation from some desired beam shape, integrated again over all frequencies? Is it mean squared average narrowness over all frequencies?
You probably would want to start looking into MVDR beamforming; that's (as far as I'm aware) the methodology best-explained in literature. To get there, get a good textbook: I flicked through Optimum Array Processing once, it seemed fined. I think we used to have "Array Signal Processing" by Johnson, and Dudgeon in the institute's library, but can't quite remember. If you have access to a university library, take the question "I want to learn about wideband beamforming, and been recommended these two books. Do we happen to have them or related books available?" to a librarian. They are probably a great help telling good from bad literature, entry-level from super-specific, simplified from overly detailed.