Weight representations avoid the regress
One part of a context dependent vector representation is a context-independent weight representation, which provides a “a contextually stable representation of constituents from which context dependent expressions maybe constructed”.
Noel Sharkey and Stuart Jackson (1994), p.168.