What general term describes the failure mode in which a model's deployment input distribution differs from its training distribution, degrading performance, and which sequential imitation learners induce on themselves?
Show answer
Distribution shift
Distribution shift (the input-only case is called covariate shift) occurs whenever deployment data is drawn from a different distribution than training data. In sequential decision problems it is self-induced: a policy's own actions steer it into states its training data never covered.
Also asked as:
- What term refers to the discrepancy between training and test data distributions that sequential decision-making agents often induce on themselves through their own actions?