Connectionist networks exhibit lawful behaviour without following explicit rules. Reguarlities emerge from the interactions of low-level processing units not from the application of high-level rules.
A network's behaviour may be characterizable by high level rules, but none are involved in its underlying mechanism.
David Rumelhart, James McClelland, & FARG 1986.