I am studying some examples of how to perform 3D instance segmentation in indoor scenes, and I have noticed many of the available datasets are from real environments. I was wondering with the availability of animation and computer graphics why people don't use these methods to create datasets ?
For one thing they are much, much simpler to annotate (for example for instance segmentation) since we already know the objects in the scenes. And we will have a lot more variety in the dataset since we have a much bigger freedom in in choosing and manipulating the objects in the scene (type of objects, color, lighting).
I do understand that for some more advanced tasks like analysing how humans interact with the environment the animations would be less realistic, but for tasks like instance segmentation it seems to me that the datasets would be accurate enough.
I do understand that creating these scenes (specially if we want to create an animation) could also be time consuming but wouldn't that be offset by the ease of annotation ? (specially for 3D scenes)
So what am I missing here ? why don't we have more of these types of datasets ? what is the drawback of using such a dataset ?