Facts about the brain may be irrelevant
Structures at different levels of organisation are often dissimilar. Thinking may have little in common with the neural structures it's implemented in. Basing a theory of cognitive architecture on a theory about the brain requires care.
For example, rocks and rivers have little in common with the atoms they are constructed of.
Jerry Fodor & Zenon Pylyshyn, 1988.