New Metric Reveals Flaws in RAG and Agent Retrieval Systems

A researcher introduces the bits-over-random metric, showing that retrieval methods performing well in benchmarks often function as noise in real RAG and agent workflows. The finding challenges how developers evaluate retrieval quality and could reshape best practices for building AI systems.