FORTE: A Production Framework for Feature Evaluation and Deprecation in Industrial Recommender Systems
Production recommender systems have feature-lifecycle asymmetry: adding new features must produce gains on some metric, while feature removal must not regress any metric. In practice, feature deprecation is hard to prioritize as a feature can fail to be removed if it interacts with other features, its importance changes daily, it cannot be evaluated before production models change or data drift…
We haven't written up this one. arXiv cs.AI has the full story — the link below goes straight to it.
