Tag: AI Model Positional Bias
Distortion in language models and AI systems that favor information located in specific positions of the input context, typically at the beginning or end of the sequence. A relevant phenomenon in transformer architectures and LLMs, with impacts on retrieval-augmented generation, ranking, summarization, and reasoning tasks on long contexts.
