Distractor Robustness: RECKONING Significantly Outperforms FT-ICR in Reasoning Over Irrelevant Facts

The study confirms that RECKONING's ability to disentangle relevant knowledge is maintained even when scaling the model size using GPT-2-XL-LoRA