I think a third way may emerge, with plastic weights / continual learning or something
Depends on which modalities. Some yes, some no.
How will this resolve?