lamarckian inheritance in biology means that children of a blacksmiths will inherit his strong hands
mostly discredited, but scientists observe similar patterns
for ai, this can be understood such that
- a generation of language models, eg, gpt35 in late 2022, creates a bunch of training data
- this data represents the models probability distribution, incl its behavior, biases, breadth and depth of knowledge
- a new generation of demos are trained on this data and thus "inherit" those traits of the parent model, esp. pronounced with model distillation