- Did you directly do edge detection on the image or did you do edge detection on individual color domains and then merge them? The latter generally produces better results.
You can try doing edge detection on individual color domains and then merge them, using your method of choice for edge detection.
Compared to edge detection directly on the color image, it might produce better results.