Distributionalism is a general theory of language and a discovery procedure for establishing elements and structures of language based on observed usage. The purpose of distributionalism was to provide a scientific basis for syntax as independent of meaning. Zellig Harris defined 'distribution' as follows.“The DISTRIBUTION of an element is the total of all environments in which it occurs, i.e. the sum of all the (different) positions (or occurrences) of an element relative to the occurrence of other elements[.]”Based on this idea, an analysis of immediate constituents could be based on observi
Distributionalism is a general theory of language and a discovery procedure for establishing elements and structures of language based on observed usage. The purpose of distributionalism was to provide a scientific basis for syntax as independent of meaning. Zellig Harris defined 'distribution' as follows.“The DISTRIBUTION of an element is the total of all environments in which it occurs, i.e. the sum of all the (different) positions (or occurrences) of an element relative to the occurrence of other elements[.]”Based on this idea, an analysis of immediate constituents could be based on observing the environments in which an element, such as a word, appears in corpora.
However, in American linguistics in the 1960s, distributionalism became replaced by Noam Chomsky's proposal of transformational generative grammar. It proposed that the constituency structure is the manifestation of innate grammar, allowing the preservation of autonomous syntax.
Discovered by embedding cosine similarity (sentence-transformers MiniLM, 384-dim).