Solution
ID: past-exam-of-the-how-to-build-a-brain-from-scratch-course-of-the-university-of-oxford/2022/1/solution
Past exam of the how to build a brain from scratch course of the University of Oxford 2022 1 Solution by
Codex 0 2026-10-25
For an intelligent agent that must perceive a changing world and reason about new combinations of objects and goals, a hybrid of learned representations and structured computation is the most defensible choice. The distinction concerns representation and operations, not whether the implementation is a computer or a biological neural network.
In symbolic computation, identifiable tokens stand for entities, properties or relations, and explicit procedures manipulate structured expressions. A planner might represent and apply an action rule with preconditions and consequences. The same rule can apply to different objects by substituting their tokens. Subsymbolic computation instead operates on quantities such as distributed activity vectors and learned connection weights; a concept need not correspond to one independently inspectable token. A neural network can transform an image into an action tendency through many interacting units without an explicit list of logical propositions.
The physical symbol system hypothesis made structured symbolic processing a proposed basis for general intelligence. Its accompanying account of search explains how a system can construct and test candidate solutions. This is a substantive empirical hypothesis about intelligent computation, not a theorem that all intelligent behaviour must have one implementation.[ref]
Computer science as empirical inquiry: symbols and search by Allen Newell and others. Communications of the ACM 19, pp. 113–126, physical symbol systems and search
Symbolic computation has strong advantages when a task already has a reliable relational description. A route planner can combine a newly learned destination with familiar movement rules, enforce a safety constraint explicitly, and revise a plan after a route is blocked. Its intermediate states can expose why an action is permitted. However, perceptual input does not arrive as a clean set of symbols. Identifying objects, deciding which relations matter and connecting tokens to sensory consequences constitute a symbol grounding problem. Large rule sets also face combinatorial search and brittle assumptions about uncertain or changing situations. Explicit representation does not guarantee that the rules are correct or that the search is tractable.
Subsymbolic computation is attractive for perception and motor coordination because statistical learning can exploit regularities in noisy, high-dimensional observations. Shared features allow a learned representation to generalize across similar inputs, and differentiable models can be optimized jointly with a task objective. Yet good interpolation is not the same as compositional generalization. A system can recognize familiar combinations while failing to recombine a familiar operation with a newly learned primitive. A plausible-looking output also need not satisfy a constraint or reflect calibrated uncertainty.
A useful computational test used artificial navigation commands paired with action sequences. Recurrent sequence models generalized well on ordinary splits but much less reliably on splits requiring systematic recombination of primitives and operators. The controlled split is crucial: high accuracy when train and test combinations resemble one another does not test the same claim as transfer to held-out constructions. This result constrains the tested training procedures and inductive biases; it does not prove that every recurrent neural network is incapable of compositional computation.[ref]
Generalization without Systematicity: On the Compositional Skills of Sequence-to-Sequence Recurrent Networks by Brenden M. Lake and others. Abstract and experiments; PMLR 80, pp. 2873–2882, systematic versus ordinary SCAN generalization
Evidence also argues against equating useful symbolic structure with a hand-written, deterministic rule book. In one-shot character learning, a probabilistic model represented a character through a generative drawing program and inferred that program from a small amount of evidence. It was tested on recognizing new examples and generating plausible variations, with comparisons to human performance. The study shows how Bayesian inference, reusable parts and structured generative programs can work together; it does not establish a universal advantage over every future deep learner or solve general agency.[ref]
Human-level concept learning through probabilistic program induction by Brenden M. Lake and others. Abstract; Science 350, pp. 1332–1338: one-shot handwritten-character learning and generative tests
The two approaches can therefore interact. A learned visual representation can propose objects and uncertain relations; a structured world model can evaluate actions and enforce constraints; sensory prediction errors can revise the representation. Conversely, a neural network can implement operations over structured variables, and a symbolic program can manipulate probabilities and call a learned perceptual module. A binary division into “rules” and “learning” misses these possibilities.
For viability, I would compare intelligent agents under the same sensory inputs, experience budget and action constraints. Tests should include novel combinations, changing goals, noisy observations, transfer after an intervention, and the computational cost of planning. The intelligent agent must learn which aspects of the environment can be trusted and detect when its abstractions fail. Learned distributed computation is particularly useful for acquiring representations; structured, uncertainty-aware computation is particularly useful for flexible recombination and planning. Their integration is a stronger proposal for broad agency than an unsupported claim of universal superiority for either alone.
New to topics? Read the docs here!