Your problem falls into the category of problems known as $Multitarget\; Tracking$. Are there algorithms?, you Betcha there are algorithms. This is an active area of research. IEEE Explore returns 1,620 hits for (multitarget tracking)
The optimal algorithm is known as Reid's Multi Hypothesis Tracker (MHT), which unfortunately requires the exhaustive enumeration of an exponentially growing set of hypothesis. There are various heuristics to keep thing manageable.
Another contender is Bar Shalom's Joint Probability Data Association Filter (JPDA) which isn't optimal, but is more manageable.
There are numerous other algorithms as well. Fundamentally, the general problem is NP hard.
The essential problem is that if each measurement was labeled from each source, the data could directly update something like a Kalman Filter for each object. Unfortunately, data is not labeled, and there are also false and missed measurements. Most approaches attempt the data association anyway.
Most implementations are closely held, As far as Matlab code goes, you can try.
https://www.mathworks.com/matlabcentral/fileexchange/43526-multiple-target-tracking-with-multiple-observations
Most free code that I've seen only do data association over a single measurement epoch, not over multiple epochs.
If you want to look at books,
Multiple-target Tracking with Radar Applications
Book by Samuel S. Blackman
Multitarget-Multisensor Tracking
Book by Yaakov Bar-Shalom
If you don't want to turn this problem into a lifelong obsession, (too late for me) , I would suggest doing a k-means for a reasonable number of k's, at each time instance. formulate a heuristic of what looks best, and then update a set of something like a set of Kalman Filters. This will work until you have crossing targets, and then you have to come up with another heuristic.