I have at least encountered many LLMs with many school's worth of algebra knowledge, but fail miserably at algebra problems.

Similarly, they've ingested human-centuries or more of spelling bee related text, but can't reliably count the number of Rs in strawberry. (yes, I understand tokenization is to blame for a large part of this. perhaps that kind of limitation applies to other things too?)