Regarding: "In my opinion, it doesn't matter. A busy channel is a busy channel."
That is not entirely correct. In the FCC world of co-channel interference the ratio of desirable to interference ratio is paramount. In the UHF band it is 39/21 dbu. TSB-88 further refines the levels. So it is possible and legal for two or more systems within range to successfully operate at the same time and separate because of capture. System separator codes, i.e. DMR color codes, PL tones etc, allow the users to maintain sanity and avoid system confusion.
Regarding: "Talk groups, timeslots, and contacts are enough."
You sir may have indeed answered my question. The combination of talk groups plus color codes may indeed be the reason why Motorola and ETSI never saw the requirement to go beyond 16 color codes. TG's act as a multiplier to the color code to allow sanity between co-channel DMR systems in busy markets.