Poor non-linguistic performance Why Core problem: LLMs are not knowledge bases, they are probabilistic models of knowledge bases.