The parietal cortex and the representation of time, space, number and other magnitudes

Domenica Bueti, Vincent Walsh

Abstract

The development of sub-disciplines within cognitive neuroscience follows common sense categories such as language, audition, action, memory, emotion and perception among others. There are also well-established research programmes into temporal perception, spatial perception and mathematical cognition that also reflect the subjective impression of how experience is constructed. There is of course no reason why the brain should respect these common sense, text book divisions and, here, we discuss the contention that generalized magnitude processing is a more accurate conceptual description of how the brain deals with information about time, space, number and other dimensions. The roots of the case for linking magnitudes are based on the use to which magnitude information is put (action), the way in which we learn about magnitudes (ontogeny), shared properties and locations of magnitude processing neurons, the effects of brain lesions and behavioural interference studies. Here, we assess this idea in the context of a theory of magnitude, which proposed common processing mechanisms of time, space, number and other dimensions.

1. Introduction

There is a great deal of evidence to suggest that quantities that can be approximated are ubiquitous throughout different species, different cultures and in all phases of human life. The functional organization of the brain is a product of evolution and development and therefore carries clues as to why the brain is organized as it is. A main feature of our magnitude perception is similar to other dimensions, i.e. they obey Weber's law across species, developmental stages and tasks. In one sense, this is unremarkable—sensory systems take ratios—but the extent to which magnitude sensitivity is similar is a good guide to whether similar mechanisms are being used. Thus, the performance of infants on number, time and area tasks (Brannon et al. 2006; Halberda et al. 2006; van Marle & Wynn 2006), of pigeons and rats on time and numerosity tasks (Church & Meck 1984; Brannon & Roitman 2003), of monkeys (Hauser et al. 2000; Cantlon & Brannon 2006) and apes (Rumbaugh et al. 1987; Boysen et al. 1995; Beran & Rumbaugh 2001; Murofushi 2002; Beran 2007) on temporal and number tasks is strongly suggestive of shared mechanisms across species and development. Manipulating magnitudes is also a feature of our language reasoning (Kemmerer 2005) in other domains such as our mental representation of maps and graphs (Feeney et al. 2004).

Some time ago, Walsh (2003a,b) proposed in a theory of magnitude (ATOM) that commonalities between time, space, number, size, speed and other magnitudes were to be found in the parietal cortex because of the need to learn about the environment through motor interactions and therefore to encode these variables for action. The hypothesis has so far successfully predicted a role for visual motion areas in time perception (Nishida & Johnston 2002; Bueti et al. 2008a,b), the temporal properties of spatially defined neurons in the parietal cortex (Leon & Shadlen 2003; Walsh 2003a,b), the effects of transcranial magnetic stimulation (TMS) over the parietal cortex (see below), co-activations in the parietal cortex (see below) and the effects of dual task and action studies involving time, size, space number and action (e.g. Brozzoli et al. 2008; Conson et al. 2008; Herrera et al. 2008). The ATOM theory also remains the explanatory account of why temporal processing may share mapping metrics with space, number, size, speed and action and also why numerical processing should originate in the parietal lobes. Here, we review recent advances in exploring the extent to which different magnitude dimensions may access common neuronal sources with particular reference to the parietal lobes.

2. Behavioural interactions between magnitudes

A good test of common resources being shared across magnitudes is to look for examples of behavioural interactions between them, and there are now several elegant and inventive accounts of interactions between time, space and number. One prediction from ATOM is that there should be some monotonic mapping of quantities: bigger, faster, brighter, further in one domain should correlate with bigger, faster, brighter, further in another. This kind of intuitive ‘more A–more B’ mapping has been noted in developmental contexts and described in some detail by Stavy & Tirosh (2000) who gave many examples of such mapping and reinterpreted several classical findings from developmental psychology (also cf. Kaufmann & Nuerk 2006; Rousselle & Noel 2007, 2008). Stavy and Tirosh suggested that children will often base magnitude judgements on irrelevant dimensions. One of their studies demonstrating this showed children two trains running along a track. The children were given all the information necessary to know that the trains ran at the same rate. When the trains differed in size, however, the subjects stated that the larger train was faster. In this case, size is affecting a judgement (speed) in which time is implicit, but children make the same class of error when making explicit temporal judgements. Levin (1977, 1979, 1982) asked children in kindergarten to judge which of two lights was presented for the longest time. The lights differed in brightness and size and the children consistently judged the larger or brighter stimuli to have persisted for more time.

These intuitive mappings are not limited to children. Xuan et al. (2007), for example, asked adult subjects to make duration judgements on stimuli that varied in non-temporal attributes such as size, luminance and numerosity and observed that temporal estimation was influenced by these non-temporal factors—increasing magnitude led subjects to make longer temporal estimations. Adults, similar to children, are influenced by irrelevant magnitude information about size and luminance when making temporal judgements. Oliveri et al. (2008) have shown that this is also true for numbers and time. Subjects were asked to make ‘longer/shorter’ duration judgements on stimuli presented as digits compared with a standard digit 5 and found that lower digits were significantly underestimated and larger digits overestimated in duration. Similar mappings have been observed by others. Dormal et al. (2006) adapted the Stroop paradigm to duration and numerosity judgements of stimuli consisting of flashing dots. Numeracy of the dots interfered with temporal duration judgements (but not vice versa, see §3). Similarly, Roitman et al. (2007a,b) required subjects to make few/short or many/long judgements on stimuli varying in duration or number and found that subjects showed similar encoding functions and reported that sensitivity for numerical differences was finer than that for temporal differences (see §3).

3. What is time for? What is space for? Why do we have numbers? (If you were Darwin for a day …)

In constructing ATOM (Walsh 2003a,b), one of the central questions was why the parietal cortex was organized as it was. Why did parietal cortex damage lead to reports of deficits in temporal, spatial and numerical perception? Indeed, what was a smart thing such as number, one of the capacities with which humans flatter themselves, doing in the ‘zombie stream’ of the visuomotor system? (Milner & Goodale 2006). The first part of the answer given to this question was based on considering why we have representations of time and space in the first place. Temporal and spatial information are of course necessary for action: for reaching, throwing, pointing and grasping, and the objects at which we direct these actions are frequently moving. Space and time can easily be segregated in psychological experiments by immobilizing subjects' heads, eye movements, restricting their actions and presenting stimuli briefly, but in everyday activity, space and time are rarely segregated—there is no such thing as getting to the right place at the wrong time: if you throw, point, reach or attempt to grasp a moving target, you need to estimate space and time accurately. In other words, space and time are coupled metrics for action and it would be very surprising if they were not in close proximity in the brain and close to the areas required for performing sensory-motor transformations for action, i.e. in the parietal lobes.

The second part of the answer is evolutionary. Imagine you are Darwin for a day and you are charged with granting a species the ability to count. Where would be the most efficient place in the brain for this discrete numerical system? The parietal cortex is already equipped with an analogue system for action that computes ‘more than–less than’, ‘faster–slower’, ‘nearer–farther’, ‘bigger–smaller’, and it is on these abilities that discrete numerical abilities hitched an evolutionary ride. Something of the ontogeny of this is seen in the primacy children's use of using ‘amount of stuff’ rather than discrete quantity to make judgements (Halberda et al. 2006; Hurewitz et al. 2006).

A consequence of this is that magnitude information from different sources would interfere with each other. So far (§2), the examples are of interactions between time and other magnitudes but there should also be interactions between other magnitudes.

4. Behavioural interactions between magnitudes

We have seen that time interacts with other magnitudes, but it is an important component of the ATOM view that other magnitudes are seen to interact in similar ways and one of its counter-intuitive predictions is that numerical information should influence action. A number–action link is not as well established as the number–space link, of which there are many examples. Fias et al. (2001) carried out a series of experiments in which subjects performed a judgement on a stimulus attribute that was more (orientation) or less (colour and shape) associated with parietal cortex processes. The stimuli were presented along with digits that were irrelevant to the task. The orientation judgements, but not the colour or shape judgements, were influenced by the irrelevant number. A less intuitive interference study, but an important one in the context of our suggestion that discrete number evolved on the back of an analogue quantity system necessary for computing the metrics of action, by Andres et al. (2004) required subjects to perform either a grip opening or closing movement to digit stimuli. Closure was initiated more quickly for small digits and opening more quickly for large digits. Andres et al. (2008) later established that as the hand neared the object, the interaction between digit magnitude and grip aperture decreased and therefore concluded that magnitude influences action at the planning or programming stage of grasping movements (see also Ishihara et al. 2008; Badets et al. 2007). Both Lindemann et al. (2007) and Moretto & di Pellegrino (2008) found evidence that mere exposure to magnitude information automatically primes grasping actions. Subjects were presented with numerical stimuli to which they made grip responses according to the semantic (parity) or surface (colour) properties of the stimulus. Although the value of the digit was irrelevant, lower numerical values facilitated precision grip responses (associated with grasping smaller objects) and larger numerical values facilitated power grip responses associated with grasping larger objects. Lindemann et al. (2007) additionally found that larger numbers were associated with a larger initial power group. These studies show that magnitude information influences the selection of action type, but at least one study (Fischer & Miller 2008) suggested that the influence of magnitude information does not extend to the dynamics of action such as force (see also Taylor-Cooke et al. 2006). One other study places the origin of interactions between space and number earlier in the chain of processing. Stoianov et al. (2008) conducted a spatial–numerical priming experiment in which they assessed forward and backward priming with verbal responses. They observed greater effects when the spatial prime followed a number target both for number comparisons and parity judgements, and concluded that the effects could not be ascribed to spatial–numerical response codes. It is a hypothesis and experiment that deserves further exploration.

One of the predictions of ATOM was that time perception should change as a function of the distance of the events being judged. Spatial judgements are affected as a function of being made in ‘near space’ or ‘far space’ (e.g. Halligan & Marshall 1991). Another way of conceptualizing near and far space is as being in or outside of ‘action space’. If magnitude systems originate in the need to compute space, time and size for action, they should behave differently towards stimuli that are within or out with action space. Zach & Brugger (2008) tested this by requiring subjects to make duration estimates of clock movement imagined at two distances. Subjects reported time to run faster for the near clock than for the far clock. There is a possibility, however, that this experiment tested the relationship between size and time rather than distance and time.

There are several other interference studies relevant to the common cortical processing of magnitudes: number can influence attentional orientation (Fischer et al. 2003; Salillas et al. 2008); temporal judgements are susceptible to spatial–numerical association of response code (SNARC)-like effects, consistent with a generalized spatial quantity association of response code (SQUARC) effect predicted in Walsh (2003a,b), Ishihara et al. (2008) and Muller & Schwarz (2008).

5. Why do we have these intuitive mappings?

So far, we have addressed our case that there is a common magnitude system and stated how it is associated with action, but why would we continue to employ common metrics in situations where action is not required? Stavy & Tirosh (2000) detailed many examples of intuitive rules that lead one to make quantitative errors in the absence of any action (although many of them require an understanding of action). More A–more B is one of these rules. We could argue that there is magnitude interference in experiments because of latent action components or some kind of spill over from the magnitude system, but another reason is that they may provide useful heuristics for things that are statistically true about the physical world: faster things do often get further, Usain Bolt, the world's fastest man, does usually have the longest legs in the field, bigger things do usually weigh more.

Thinking about why we have these intuitive mappings may also help to explain why all magnitudes are not created equal. An oversimplistic view of a generalized magnitude system might expect all interference effects to be symmetrical that temporal cues, number, space, luminance and action cues would all impinge on each other. This is clearly not the case. Brown (1997), for example, found that number interfered with time but not vice versa, and Dormal & Pesenti (2007) for example, found that in a modified Stroop paradigm, spatial cues interfered with number processing but number did not interfere with spatial processing. Hurewitz et al. (2006) suggested a possible hierarchy of magnitudes from continuous to discrete variables following their finding that amount of stuff interfered with numerosity judgements more than numerosity interfered with ‘stuff’ (a technical term the literature should embrace). Whether these findings are evidence of constant asymmetries or are task dependent remains to be established (cf. Göbel et al. 2004). From the point of view of cortical loci, it is clear that some activation sites for time, space and number overlap and a few do not (figure 1). This should not be surprising: the architecture activated in any given experiment is highly dependent on the task and one should therefore not expect a single locus to account for all instances of magnitude processing (Cohen Kadosh & Walsh in press). Perhaps the best example of the logic is to be found in the attention literature: whereas some studies report that saccade generation directs attention, others clearly show that visual selection functions can be segregated both in time and space. That they can be segregated under some experimental conditions does not of course mean that they are not part of an integrated system for searching the visual environment (cf. Juan et al. 2004, 2008; Schall 2004; Awh et al. 2006). The importance of motor experience is best exemplified in a recent study of the SNARC effect in early blind subjects (Castronovo & Seron 2007).

Figure 1

(a) Left and (b) right hemisphere views of the human visual cortex showing activation sites reported in some functional magnetic resonance imaging studies of time (green dots), space (yellow dots), number (red dots) and size (blue dots) perceptions. These plots are based on Maquet et al. (1996), Schubotz et al. (2000), Rao et al. (2001), Macar et al. (2002), Ferrandez et al. (2003), Lewis & Miall (2003), Coull et al. (2004), Pouthas et al. (2005) and Bueti et al. (2008a,b). Note the spread of numerical activations along the length of the intraparietal sulcus (IPS) in areas also associated with space, time, size and luminance (white dots). SFS, superior frontal sulcus.

6. When temporal is not time

Events occur in time, some rapidly, some slowly and there is a trivial sense in which all behaviour is temporal. There are some cases, however, in which the time course of events is irrelevant to how the brain processes time. Two classes of this are present in the literature. One of these is the confusion between a stream of events and temporal processing. If a stream of events occurs too quickly for a subject to individuate events, then one can conclude that the system under investigation does not work that quickly, but cannot state anything about how that system processes information about time. This confusion occurs in studies that have used a version of the attentional blink paradigm or presented a sequence of events in which the subjects are required to identify and individuate stimuli. One of the current authors made this error in a study of visual search (see Coull et al. 2003; also Shapiro et al. 2002). The second class of error is to present stimuli in a temporal sequence but not to require the subjects to make any temporal judgements. This has occurred when temporal versions of the Posner paradigm have been used to test what has been called temporal attention. In the first of these experiments (Coull & Nobre 1998), subjects were presented with stimuli that cued a short time or a long time response (300 versus 1500 ms). As in the spatial Posner paradigm, the cues were incorrect some of the time. However, when cued to expect the long interval, the task is no longer one of temporal prediction because the subject knows that a cue to action will appear in due course, i.e. the task becomes one of simple response preparations to an external stimulus. This is evident in the behavioural data that fail to show a cueing effect for long intervals and may account for the anterior left hemisphere parietal activity (most probably associated with movement preparation; e.g. Schluter et al. 2001) reported in that study and preparation-related differences in a later study (Miniussi et al. 1999).

7. The role of the parietal cortex in magnitude processing

The most important region of the cortex associated with temporal processing is the parietal cortex. Regions within the parietal lobe are consistently associated with temporal processing in neuropsychological, brain imaging, single-unit recording and TMS studies. Here, we review some of the core findings that address the issue of common cortical metrics of time and other magnitudes.

(a) Neuropsychological findings

The range of neuropsychological case studies of time perception is reviewed by Koch et al. (2009). The relationship between parietal damage and temporal deficits has long been recognized (cf. Critchley 1953; Harrington et al. 1998; Battelli et al. 2007, 2008). Critchley in his seminal book on the parietal lobes wrote: ‘…most interesting and complicated of all are those spatial disorders which also involve the conception of time … one must distinguish between a primitive time sense, and a gnosic time-conception (by which is meant an understanding of chronological order)…’. Neuropsychological studies have clearly shown that the right parietal lobe, and in particular the intense pulsed light (IPL), might play an important role in discriminating events that are displaced in time. Patients with IPL lesions demonstrate deficits in visual event discrimination in both visual fields and that often coexist with other visuospatial deficits only in the field contralateral to the lesion (see Battelli et al. 2007, 2008 for reviews). Battelli has also suggested that bilateral parietal damage may be necessary for a timing deficit and might distinguish purely visual timing deficits from spatial ones. Other studies support Battelli's view and report deficits similar in nature to the visual timing of events, and bilateral timing deficits have been reported for visual search tasks requiring spatio-temporal segmentation (e.g. Van Vleet & Robertson 2006). The regions of damage that lead to temporal deficits also frequently cause spatial, numerical and velocity perception deficits (e.g. Cipolotti et al. 1991; Basso et al. 1996; Battelli et al. 2003; Becchio & Bertone 2006; Danckert et al. 2007, see also Cavezian et al. 2007; Zamarian et al. 2007). From the point of view of ATOM, neuropsychological patient studies can be indicative of overlapping mechanisms, but the types of lesion that patients usually suffer are too large to allow structural conclusions to be drawn.

(b) Brain imaging studies

Brain imaging studies consistently show that time, space, number and other magnitudes such as size and brightness activate overlapping regions in the parietal cortex. Kaufmann et al. (2008) have recently performed an important comparison of adults and children making non-symbolic numerical decisions and spatial decisions. Their data reveal evidence of the role of the action system in learning about magnitudes and of overlapping representations in adults. Adult subjects' brain activations showed overlapping space and number regions in the posterior superior parietal lobule, whereas children showed relatively more activation in the supramarginal gyrus, the lateral anterior intraparietal sulcus (IPS) and the precentral gyrus. Kaufmann et al. (2005) have also compared activations for number and size using a Stroop-like paradigm in which subjects viewed pairs of digits that varied in numerical value and/or size and required to make a judgement on either the value or the size. Differences as a function of congruity were not observed in the IPS, only in the prefrontal and anterior cingulated cortex, suggesting that IPS regions concerned with number and size overlapped. Cohen Kadosh et al. (2007ac, 2008a,b) have carried out similar analyses on number–luminance and number–size pairings. In their number–size experiment (Cohen Kadosh et al. 2007ac), they observed motor activity associated with incongruous trials and concluded that the locus of interference is late in the processing stream—at the point of response initiation (cf. Andres et al. 2008 for similar conclusions based on behavioural experiments). They also observed that interaction between the stimulus attributes occurred only in high load conditions. This is an important caveat not usually addressed in Stroop-like studies of magnitude. In their size–number studies, they also show that interference between the two variables is reflected in parietal cortex activity (see also Pinel et al. 2004; Cohen Kadosh et al. 2005; Liu et al. 2006; Zhou et al. 2006). Studies of the parietal cortex and time perception consistently report a network of areas that include regions of the parietal cortex as well as the prefrontal cortex, supplementary motor area, cerebellum and basal ganglia (e.g. Macar et al. 2002; Coull et al. 2004; Lewis & Miall 2006a,b). A sophisticated approach to parsing time functions is taken by Lewis & Miall who divide temporal functions into cognitive and non-cognitive domains in which the dorsolateral prefrontal cortex is important to both cognitive timing and working memory and the parietal cortex is associated with more automatic temporal processing.

There is also evidence of a role for the IPS in auditory magnitude processing (von Kriegstein et al. 2007), an area that is not addressed in ATOM.

(c) Single-unit studies

Neurons in regions of the parietal cortex in monkeys have been shown to be selective for the aspects of magnitude. Onoe et al. (2001) led the way with a positron emission tomography study of monkeys performing temporal duration discriminations. They observed duration-related activity in the dorsolateral prefrontal cortex and inferior parietal cortex, and suggested that the parietal activation may be due to relaying duration estimations to be matched with a stored standard. Presciently, they also suggested that ‘temporal information in these regions may be coded in neurons with multiplex properties and/or in cell assemblies with overlapping connections in the same region’. Subsequently, Leon & Shadlen (2003) observed temporally related activity in the monkey posterior parietal cortex, but it is important to note that these putative temporal neurons were de facto spatial neurons predefined by their spatial response fields (see Walsh 2003a,b). Janssen & Shadlen (2005) have also recorded activity in the lateral intraparietal cortex consistent with predicting when an event will occur. These spatio-temporal neurons overlap (indeed may be the same multiplexed neurons) with neurons displaying responses to numerical information. Sawamura et al. (2002) recorded number-selective neurons in the intraparietal sulcus and superior parietal lobule (see also Sawamura et al. 2006). These neurons recorded in the lateral intraparietal sulcus are strong candidates for the locus of a population with generalized magnitude properties because their responses are often dependent on spatial information. Neurons in the ventral intraparietal region, however, also have some interesting magnitude features. Nieder's laboratory, for example, has shown that neurons responsive to numerical information are also sensitive to non-numerical task information (Nieder et al. 2006; see also Calabrese 2007). And while some reports have concentrated on number-specific responses (Nieder & Miller 2003; Nieder 2004, 2005; Roitman et al. 2007a,b), it is also clear that neurons in the posterior parietal cortex encode different forms of quantity information (Tudusciuc & Nieder 2007). The posterior parietal cortex is not the only area that shows magnitude-selective response—following Onoe et al., neurons responsive to elapsed time or number have been found in the dorsolateral prefrontal cortex (Nieder et al. 2002; Genovesio et al. 2006).

(d) Transcranial magnetic stimulation studies

If different magnitudes rely on the parietal cortex, then interfering with parietal regions should yield deficits on tasks related to time, space, number and other magnitudes. The first study of TMS effects of number processing (Göbel et al. 2001) showed that temporary interference with the right angular gyrus disrupted the spatial representation of the number line. Later studies have shown that TMS over the right parietal cortex, in particular the IPS, can also prevent the automatic processing of magnitude information (Cohen Kadosh et al. 2007ad). TMS over the right IPS, however, has less effect on automatic number processing and only an effect limited to the right side of space on the mental number line (Göbel et al. 2006a,b). Dormal et al. (2008) applied off-line repetitive TMS to the right and left parietal cortex and observed an effect on a number comparison task only over the right IPS. Other studies, however, have obtained temporal processing effects following right parietal stimulation (Alexander et al. 2005). The strong links between space and number and time and number have also been explored with TMS. Knops et al. (2006) delivered repetitive TMS over the right posterior parietal lobe and observed neglect-like symptoms on a line bisection task, i.e. subjects' perceived midpoint of a numerical interval shifted to the right as a consequence of TMS. Oliveri et al. (2004) also observed a correction of bias to the left following right IPS TMS (see Bjoertomt et al. 2002 for a spatial analogue of the numerical effect). The effects on any numerical, spatial or temporal task are strongly affected by task demands (Göbel et al. 2004). For example, when numerical responses are associated with finger counting, it is the left parietal cortex that is susceptible to TMS interference (Rusconi et al. 2005).

8. ATOM revisited

We have seen several lines of recent research that have tested the theoretical position that time, space, number and other magnitude processing originate in a common system for magnitudes. Before reviewing where ATOM stands now, it is worth recapping its major points and predictions. The mental representations of time, space, size, number and other magnitudes are largely studied within separate literatures, but the neuropsychological evidence from patients strongly suggested some commonality in the locus of lesions causing deficits in these domains. Based on some TMS studies, behavioural data and reinterpretations of imaging and single-unit studies, it was suggested that different magnitudes originated from a single developmental algorithm for more than–less than distinctions of any kind of stuff in the external world. The development of magnitude processing proceeds by interactions with the environment and is therefore closely linked with the motor reaching, grasping and manipulating of objects. It was further suggested that the emergence of our ability to manipulate discrete quantities evolved from our abilities with continuous quantities (see §3). Among the predictions made were that different magnitudes should show interference and priming effects; that other brain areas associated with magnitude processing (such as V5 for motion processing) should also display some evidence of involvement in other magnitudes (in the case of V5, time; see Bueti et al. 2008a,b); and that the SNARC effect, in which small number judgements are associated with response codes in left space and large numbers with response codes in right space, should prove to be a SQUARC effect in which any spatially or action-coded magnitude will yield a relationship between magnitude and space (cf. Notebaert et al. 2006). All of these predictions have been confirmed to date.

One issue that may be developed more fully in ATOM is that of hemispheric asymmetries (see Woods et al. 2006; Niemeier et al. 2007). Owing to the association of numerical mapping with space, there is an emphasis on right hemisphere functions, but it is clear that explicit numerical operations and motor action selection and preparation rely on left parietal cortex mechanisms. It is also clear that if learning about magnitudes in the world is first achieved through interacting with them as an infant (‘can I lift that; can I get over that; can I gather these; can I get all this in my mouth’?), there will be a close relationship between the right hemisphere registration of continuous quantities and left hemisphere mechanisms involved in action (cf. Andres et al. and Lindemann et al. for example above).

As noted in Walsh (2003a,b) (figure 1), the parietal cortex, although it may be considered the ‘primary magnitude cortex’, is only one locus of magnitude processing—there is a magnitude system not a single magnitude area. Accordingly, magnitude processing also overlaps in the prefrontal cortex both in monkeys (Nieder & Miller 2004; Diester & Nieder 2007) and humans (Burbaud et al. 1995; Rickard et al. 2000; Pochon et al. 2001; Rao et al. 2001; Ferrandez et al. 2003; Kansaku et al. 2007; Vallesi et al. 2008; see Lewis & Miall 2006a,b for a framework).

With any system that is distributed between visual areas, it will be possible to construct dissociations. In the visual system, for example, one can study colour, form or motion and show task-specific dissociations between them. When we see, of course, we see coloured forms moving and therefore need to know both how these specializations evolve and develop and how they form coherent percepts. In the magnitude domain, we can concentrate on size, distance, time or number and we therefore need to understand the evolution and development of these specialization; but, as in vision, when we interact with the world we do so in time and space, so much so that dissociations between them probably tell us more about the strange things we can make people do in experiments rather than how the brain operates in the real world (it is out there; cf. Glasauer et al. 2007): there is no such thing as getting to the right place at the wrong time—shaking hands, kissing, catching, throwing, playing an instrument, gathering kindling or paying by cash all require spatio-temporal coordination. Behaviour may be spatial or temporal in a laboratory, but in the real world they originate in the same coordinate system applied to all magnitudes.

Two questions remain about the view presented in this paper: what are the specific operations underlying magnitude representation and what does the generalized magnitude view mean for models of timing such as internal clock mechanisms? The first question is easier. ATOM has value because it has limits; not all aspects of space, time and number are suggested to lie within a common origin and there is no necessary prediction that ATOM should extend to episodic memory, planning, mathematical operations or allocentric spatial tasks such as navigation. The proposal is that we learn about space and time through action and associations between space, time and magnitudes relevant for action (such as size, speed and, under some conditions, luminance and contrast) will be made through action. When we later learn about number, the neurons with capacity to represent quantity are those that have information about the continuous variables learned about motorically. Thus, the neuronal scaling mechanisms used for dimensions with action-relevant magnitude information will be co-opted in development for the scaling of number. Psychophysically, this has been shown to be the case (Burr & Ross 2008); the relevant neurons are found, as predicted, in the parietal cortex and dual-task experiments show interference between number and action (see above). The single-unit recording literature erroneously emphasizes neurons specialized for time (cf. Walsh 2003a,b), space or number, but we suggest that this is a consequence of the immature state of the field. Similar overemphasis of specializations in the visual system led to concentrating on such things as ‘the colour area’, ‘the form area’ or ‘the motion area’, but it is now clear that many neurons at every level of visual analysis are double or even triple duty for form, motion and chromatic content. Given the similarity of rules observed by sensory processing within and between modalities (Shamma 2001; Sur & Leamey 2001), we predict that similar multi-duty neurons will be reported in the magnitude scaling system in due course. The second question cannot yet be answered: the basis for ATOM is not constrained by any proposed mechanisms of timekeeping and is consistent with clock or non-clock explanations.

Footnotes

  • One contribution of 14 to a Theme Issue ‘The experience of time: neural mechanisms and the interplay of emotion, cognition and embodiment’.

References

View Abstract