Computer science, the academic discipline, is to programming as mechanics is to bowling.
You can very easily test CS concepts on paper, and programming is demonstrated via group projects.
Absolutely. It makes good sense to describe algorithms on paper via pseudo-code and diagrams, but they shouldn't be expected to write working code on paper.