> I think the proponents of the theory need to explain by which mechanism the actual loss of information supposedly occurs (on the probability distribution of possible LLM outputs). Is it averaging? Added randomness? Preferential skew? To me, it is rather vague, to the point I don't see how it's different from what humans have done for centuries.
This is the pure incredulity that I was talking about.
No, it's skepticism. I think proponents of that hypothesis should come up with some testable prediction, how is that supposed "loss of quality" affecting the distribution of possible LLM outputs. Then we can have debate on it's effects and relevance to existing human cultural output. (But I already ran over various options, and the above is the conclusion I came to.)
This is the pure incredulity that I was talking about.