Brain stimulation reward
Encyclopedia
Brain stimulation reward (BSR) is a phenomenon in which direct stimulation of regions of the brain through either electrical or chemical means is rewarding and can serve as an operant reinforcer. The stimulation activates the reward system
and establishes response habits similar to those established by natural rewards such as food and water. BSR experiments soon demonstrated that stimulation of the lateral hypothalamus
and other regions of the brain associated with natural reward was both rewarding as well as drive inducing. Electrical brain stimulation
and intracranial drug injections are among the most powerful rewards because they activate the reward circuitry directly rather than through the peripheral
nerves. BSR has been found in all vertebrates tested, including humans, and it has provided a useful tool for understanding how natural rewards are processed by the brain as well as the anatomical structures and the neurochemistry associated with the brain's reward system.
and Peter Milner observed that rats preferred to return to the region of the test apparatus where they received direct electrical stimulation to the septal area of the brain. From this demonstration, Olds and Milner inferred that the stimulation was rewarding, and through subsequent experiments, they confirmed that they could train rats to execute novel behaviors, such as lever pressing, in order to receive short pulse trains of brain stimulation. Olds and Milner discovered the reward mechanisms in the brain involved in positive reinforcement and their experiments led to the conclusion that electrical stimulation could serve as an operant reinforcer. According to B.F. Skinner, operant reinforcement occurs when a behavior is followed by the presentation of a stimulus, and it is considered essential to the learning of response habits. Their discovery enabled motivation
and reinforcement to be understood in terms of their underlying physiology, and it led to further experimentation to determine the neural basis of reward and reinforcement. Since the initial discovery, the phenomenon of BSR has been demonstrated in all species tested, and Robert Heath similarly demonstrated that BSR can be applied to humans.
with some degree of anatomical and neurochemical specificity. Studies involving these two forms of laboratory reward showed stimulation of a broad range of limbic and diencephalic structures could be rewarding as well as implicated the dopamine
-containing neurons of the mesolimbic dopamine system in motivational function. The motivational effect of intracranial self-stimulation varies substantially depending on the placement site of the surgically implanted electrode during electrical stimulation, and animals will work to stimulate different neural sites depending on their current state. Oftentimes, animals that work to initiate brain stimulation will also work to terminate the stimulation.
, pulse duration
, or pulse frequency
. The reward magnitude can be controlled as a function of stimulation intensity, and intensity is often used as the independent variable in studies to determine anatomical localization since high intensity stimulation is most likely to reach distal reward sites, whereas stimulation at low intensity is useful in localizing the boundaries of reward sites. Manipulation of stimulation frequency, the number of pulses per second, is preferable in pharmacological studies, which demonstrate an increase in response rate due to an increase in frequency. The independent variables of train and pulse duration can also be varied to determine the response rate of brain stimulation reward. Longer train durations produce more vigorous responding up to a point, after which rate of responding varies inversely with train length because animals begin to lever-press for additional stimulation before the previously earned train has finished.
Stimulation intensity, pulse duration, or pulse frequency can be varied to determine dose-response functions for BSR using the curve-shift paradigm, which generally resembles traditional pharmacological dose-response curves where the dose of stimulation rather than the dose of a drug is examined. This method allows the impact of a reward-altering treatment to be quantitatively estimated. In the curve-shift paradigm, low doses of stimulation fail to sustain the lever-press habit at a probability above chance. The response rates increase rapidly over a dynamic range of stimulation values as the stimulation dose increases, and once the high stimulation dose is reached, further increase in stimulation value does not yield a further increase in response rate over the subsequent static range. The response rate of brain stimulation reward in the dynamic range is sensitive to changes in the rewarding impact of stimulation, and changes in the rate of response over this range reflects changes in the reward magnitude . Rate-frequency, rate-intensity, or rate-duration functions make inferences about the potency and efficacy of stimulation, as well as elucidate how drugs alter the rewarding impact of stimulation. Analysis of the curve functions under experimental and control conditions determine whether the experimental treatment shifts the function. Experimental changes in the efficacy of stimulation that cause a shift up or down to a higher or lower asymptotic performance level reflect changes in the performance capabilities of the animals, whereas shifts to the right (to higher stimulation values) or to the left (to lower stimulation values) reflect synergism or antagonism of the rewarding impact of stimulation that determine its potency.
(MFB) through either electrical or chemical means activates the neural pathways leading to natural drives. When specific regions of the hypothalamus
are electrically stimulated, the stimulation causes eating, drinking, or copulation responses, and electrical stimulation is more reinforcing when the natural reward is available for consumption.
The difference between brain stimulation and natural rewards can be attributed to the lack of a deprivation state for brain stimulation that instinctively facilitates the drive to seek out brain stimulation. BSR also lacks the established neural representation in the animal’s memory that naturally facilitates the learning of reward expectancy. Both of these effects lead to diminished response rate for BSR in the early trials of a series; however, experiments have also shown that extinguished behavior can be quickly reinstated by a priming
stimulation that refreshes the short-term association involved in reward expectancy. Experiments on BSR indicate that reinforcing brain stimulation may activate the natural pathways associated with natural drives as well as stimulate the reinforcement pathways that are usually activated by natural rewards.
. Multiple studies have demonstrated that rats will perform reinforced behaviors at the exclusion of all other behaviors. Experiments have shown rats to forgo food to the point of starvation in order to work for brain stimulation or intravenous cocaine
when both food and stimulation are offered concurrently for a limited time each day. Rats will even cross electrified grids to press a lever, and they are willing to withstand higher levels of shock to obtain electrical stimulation that they are to accept for food .
, a compulsive habit that is maintained despite harmful consequences. Laboratory rewards can establish compulsive self-administration habits of seeking and ingesting that qualify as addiction (1).Rats and monkeys have been shown to work in a compulsive manner to achieve intravenous injections of stimulants, and when access to the drugs is not limited, they will self-administer the drugs to the point of severe weight loss and death. This demonstrates that the habit of self-administration for intracranial brain stimulation or drug injections becomes compulsive almost immediately. BSR is hypothesized to be so effective in establishing compulsive habits because it bypasses the synaptic barriers in the sensory pathways to directly activate the reward pathway. The lack of delay in the reinforcement of a behavior motivated by BSR increases its effectiveness because even a delay of 1 second between the lever-press and the reward delivery can reduce its effectiveness . BSR offers insights into the neuroadaptations involved in reinforcement and addiction.
(MFB) through the lateral and posterior hypothalamus
, the ventral tegmental area (VTA), and into the pons
are associated with the strongest reward effects of stimulation.
is a portion of the hypothalamus, and brain stimulation to this area of the reward system produces the highest response rates and subsequently the highest reward potency. Lesions in this region or along its boundary cause a loss of positive drive-reward behaviors as well as all other operant drive behaviors.
(MFB) is the location of the most frequently investigated brain stimulation reward sites, and it is composed of a complex bundle of axons coming from the basal olfactory regions and the septal nuclei
. MFB is not the sole anatomical substrate responsible for reinforcing brain stimulation; however, it is the main pathway for the ascending dopamine fibers and it functions to relay information from the VTA to the nucleus accumbens
. The rewarding effect of the MFB depends on the ability of the stimulation to activate the mesocorticolimbic dopamine system.
contains the VTA, nucleus accumbens
, amygdale, and the medial prefrontal cortex
. The nucleus accumbens is a part of the striatum
that integrates information from cortical and limbic brain structures to mediate behaviors the reinforce reward . The nucleus accumbens is a major target for the dopaminergic projections from the brainstem that are associated with BSR. The VTA is a group of neurons located close to the midline on the floor of the midbrain, and VTA is the origin of dopaminergic cell bodies that comprise the mesocorticolimbic dopamine system.
, cocaine
, opioids, nicotine
, etc.) activate the reward circuitry of the MFB, which requires a stimulation to activate the mesocorticolimbic dopamine system. Current research focuses on the dopaminergic pathways as the substrate of brain stimulation reinforcement; however, both noradrenergic and dopaminergic pathways are important in brain stimulation reinforcement.
is activated trans-synaptically by normal rewards (food, water, copulation) but it can also be activated directly by the induced rewards of intravenous drugs or electrical or chemical brain stimulation. The mesolimbic pathway is one of the dopaminergic pathways
in the brain that modulates behavioral responses to rewarding stimuli. It originates in the VTA and connects to the limbic system
via the nucleus accumbens, the amygdala, and the medial prefrontal cortex. A number of drugs are rewarding when they are injected into the nucleus accumbens
and act as mesolimbic dopamine terminals, and the axons of the mesolimbic dopamine system have high thresholds for stimulation .
between addictive drugs and brain stimulation is the summation effect within or at the synapses of the mesolimbic system. Although dopamine
plays a fundamental role in the rewarding effects of brain stimulation and abusive drugs, the exact nature of it role is still unclear, and since the reward circuitry is multisynaptic, dopamine is not the only reward transmitter. Dopamine neurons play an important role in incentive motivation and reinforcement associated with electrical stimulation to the MFB. Initially, simulation of the MFB was thought to activate the dopamine fibers directly, it is now believed the stimulation at the MFB selectively activates afferent input into the dopamine system.
Cholinergic agents are rewarding when injected into the ventral tegmental area (VTA). Opiates including Mu and Delta opioids appear to have the strongest rewarding effects through afferents to the mesolimbic dopamine systems, and the presumed mechanism of action involves the disinhibition of the dopamine system by inhibition of nearby GABAergic neurons. Dopamine and opiate antagonists are competitive antagonists of BSR, and they impair the synaptic transmission of the reward signal either across the dopaminergic synapse or across a synapse in which dopamine has a modulatory function. On the other hand, drugs of abuse have been shown to synergize with BSR by reducing the BSR thresholds for amount of stimulation required as well as act to negate the effects of a reward antagonist. BSR synergistic drugs include: amphetamines, cocaine, heroin, morphine, nicotine, phenylcyclidine, mu and delta opioids, and cannabis. These synergistic drugs summate with BSR and serve as rewards themselves by elevating the dopamine concentration at forebrain dopamine nerve terminals, including the nucleus accumbens.
Reward system
In neuroscience, the reward system is a collection of brain structures which attempts to regulate and control behavior by inducing pleasurable effects...
and establishes response habits similar to those established by natural rewards such as food and water. BSR experiments soon demonstrated that stimulation of the lateral hypothalamus
Lateral hypothalamus
The lateral hypothalamus or lateral hypothalamic area is a part of the hypothalamus.It is concerned with hunger. Damage to this area can cause reduced food intake...
and other regions of the brain associated with natural reward was both rewarding as well as drive inducing. Electrical brain stimulation
Electrical brain stimulation
Electrical brain stimulation , also referred to as focal brain stimulation , is a form of electrotherapy and technique used in research and clinical neurobiology to stimulate a neuron or neural network in the brain through the direct or indirect excitation of its cell membrane by using an electric...
and intracranial drug injections are among the most powerful rewards because they activate the reward circuitry directly rather than through the peripheral
Peripheral
A peripheral is a device attached to a host computer, but not part of it, and is more or less dependent on the host. It expands the host's capabilities, but does not form part of the core computer architecture....
nerves. BSR has been found in all vertebrates tested, including humans, and it has provided a useful tool for understanding how natural rewards are processed by the brain as well as the anatomical structures and the neurochemistry associated with the brain's reward system.
History
In 1953, James OldsJames Olds
James Olds was an American psychologist who co-discovered the reward center of the brain with Peter Milner while he was a postdoctoral fellow at McGill University in 1954...
and Peter Milner observed that rats preferred to return to the region of the test apparatus where they received direct electrical stimulation to the septal area of the brain. From this demonstration, Olds and Milner inferred that the stimulation was rewarding, and through subsequent experiments, they confirmed that they could train rats to execute novel behaviors, such as lever pressing, in order to receive short pulse trains of brain stimulation. Olds and Milner discovered the reward mechanisms in the brain involved in positive reinforcement and their experiments led to the conclusion that electrical stimulation could serve as an operant reinforcer. According to B.F. Skinner, operant reinforcement occurs when a behavior is followed by the presentation of a stimulus, and it is considered essential to the learning of response habits. Their discovery enabled motivation
Motivation
Motivation is the driving force by which humans achieve their goals. Motivation is said to be intrinsic or extrinsic. The term is generally used for humans but it can also be used to describe the causes for animal behavior as well. This article refers to human motivation...
and reinforcement to be understood in terms of their underlying physiology, and it led to further experimentation to determine the neural basis of reward and reinforcement. Since the initial discovery, the phenomenon of BSR has been demonstrated in all species tested, and Robert Heath similarly demonstrated that BSR can be applied to humans.
Brain stimulation reinforcement
Early studies on the motivational effects of brain stimulation addressed two primary questions: Which brain sites produce a rewarding effect when stimulated? and What drugs influence the response to stimulation and how? Investigation of the brain reward circuitry reveals that it consists of a distributed, multisynaptic circuit that determines both BSR and natural reward function. The natural drives that motivate and shape behavior reach the reward circuitry trans-synaptically through the peripheral senses of sight, sound, taste, smell, or touch. However, the laboratory induced rewards of intracranial electrical stimulation or drug injections directly activate the reward circuitry and bypass the peripheral sensory pathways. For this reason, electrical brain stimulation and drug injections provide a tool for identifying the reward circuitry within the central nervous systemCentral nervous system
The central nervous system is the part of the nervous system that integrates the information that it receives from, and coordinates the activity of, all parts of the bodies of bilaterian animals—that is, all multicellular animals except sponges and radially symmetric animals such as jellyfish...
with some degree of anatomical and neurochemical specificity. Studies involving these two forms of laboratory reward showed stimulation of a broad range of limbic and diencephalic structures could be rewarding as well as implicated the dopamine
Dopamine
Dopamine is a catecholamine neurotransmitter present in a wide variety of animals, including both vertebrates and invertebrates. In the brain, this substituted phenethylamine functions as a neurotransmitter, activating the five known types of dopamine receptors—D1, D2, D3, D4, and D5—and their...
-containing neurons of the mesolimbic dopamine system in motivational function. The motivational effect of intracranial self-stimulation varies substantially depending on the placement site of the surgically implanted electrode during electrical stimulation, and animals will work to stimulate different neural sites depending on their current state. Oftentimes, animals that work to initiate brain stimulation will also work to terminate the stimulation.
Measurement of brain stimulation reward
Since the initial demonstration of BSR by Olds and Milner, lever-pressing has been used as the traditional response motivated by stimulation, and experiments have established the rate of response as the dependent variable. The rewarding stimulus in BSR experiments is typically a train of short-duration pulses separated by interval pulses, which can be manipulated experimentally using the independent variables of stimulation intensityField strength
In physics, the field strength of a field is the magnitude of its vector value.In theoretical physics, field strength is another name for the curvature form...
, pulse duration
Time
Time is a part of the measuring system used to sequence events, to compare the durations of events and the intervals between them, and to quantify rates of change such as the motions of objects....
, or pulse frequency
Frequency
Frequency is the number of occurrences of a repeating event per unit time. It is also referred to as temporal frequency.The period is the duration of one cycle in a repeating event, so the period is the reciprocal of the frequency...
. The reward magnitude can be controlled as a function of stimulation intensity, and intensity is often used as the independent variable in studies to determine anatomical localization since high intensity stimulation is most likely to reach distal reward sites, whereas stimulation at low intensity is useful in localizing the boundaries of reward sites. Manipulation of stimulation frequency, the number of pulses per second, is preferable in pharmacological studies, which demonstrate an increase in response rate due to an increase in frequency. The independent variables of train and pulse duration can also be varied to determine the response rate of brain stimulation reward. Longer train durations produce more vigorous responding up to a point, after which rate of responding varies inversely with train length because animals begin to lever-press for additional stimulation before the previously earned train has finished.
Stimulation intensity, pulse duration, or pulse frequency can be varied to determine dose-response functions for BSR using the curve-shift paradigm, which generally resembles traditional pharmacological dose-response curves where the dose of stimulation rather than the dose of a drug is examined. This method allows the impact of a reward-altering treatment to be quantitatively estimated. In the curve-shift paradigm, low doses of stimulation fail to sustain the lever-press habit at a probability above chance. The response rates increase rapidly over a dynamic range of stimulation values as the stimulation dose increases, and once the high stimulation dose is reached, further increase in stimulation value does not yield a further increase in response rate over the subsequent static range. The response rate of brain stimulation reward in the dynamic range is sensitive to changes in the rewarding impact of stimulation, and changes in the rate of response over this range reflects changes in the reward magnitude . Rate-frequency, rate-intensity, or rate-duration functions make inferences about the potency and efficacy of stimulation, as well as elucidate how drugs alter the rewarding impact of stimulation. Analysis of the curve functions under experimental and control conditions determine whether the experimental treatment shifts the function. Experimental changes in the efficacy of stimulation that cause a shift up or down to a higher or lower asymptotic performance level reflect changes in the performance capabilities of the animals, whereas shifts to the right (to higher stimulation values) or to the left (to lower stimulation values) reflect synergism or antagonism of the rewarding impact of stimulation that determine its potency.
Relationship to natural rewards and drives
The relationship between induced laboratory and natural rewards (e.g. food, water and copulation) has long been debated, and much of the early research on BSR is focused on their similarities and differences. Experiments consistently indicate that BSR stimulates the reinforcement pathways normally activated by natural rewards, and drug reward or self-stimulation can exert more powerful activation of central reward mechanisms because they activate the reward circuit directly rather than through the peripheral nerves. BSR to the medial forebrain bundleMedial forebrain bundle
The Medial forebrain bundle , is a complex bundle of axons coming from the basal olfactory regions, the periamygdaloid region, and the septal nuclei.-Anatomy:...
(MFB) through either electrical or chemical means activates the neural pathways leading to natural drives. When specific regions of the hypothalamus
Hypothalamus
The Hypothalamus is a portion of the brain that contains a number of small nuclei with a variety of functions...
are electrically stimulated, the stimulation causes eating, drinking, or copulation responses, and electrical stimulation is more reinforcing when the natural reward is available for consumption.
The difference between brain stimulation and natural rewards can be attributed to the lack of a deprivation state for brain stimulation that instinctively facilitates the drive to seek out brain stimulation. BSR also lacks the established neural representation in the animal’s memory that naturally facilitates the learning of reward expectancy. Both of these effects lead to diminished response rate for BSR in the early trials of a series; however, experiments have also shown that extinguished behavior can be quickly reinstated by a priming
Priming (psychology)
Priming is an implicit memory effect in which exposure to a stimulus influences a response to a later stimulus. It can occur following perceptual, semantic, or conceptual stimulus repetition...
stimulation that refreshes the short-term association involved in reward expectancy. Experiments on BSR indicate that reinforcing brain stimulation may activate the natural pathways associated with natural drives as well as stimulate the reinforcement pathways that are usually activated by natural rewards.
Strength of drive
Rats will perform lever-pressing at rates of several thousand responses per hour for days in order to obtain direct electrical stimulation of the lateral hypothalamusLateral hypothalamus
The lateral hypothalamus or lateral hypothalamic area is a part of the hypothalamus.It is concerned with hunger. Damage to this area can cause reduced food intake...
. Multiple studies have demonstrated that rats will perform reinforced behaviors at the exclusion of all other behaviors. Experiments have shown rats to forgo food to the point of starvation in order to work for brain stimulation or intravenous cocaine
Cocaine
Cocaine is a crystalline tropane alkaloid that is obtained from the leaves of the coca plant. The name comes from "coca" in addition to the alkaloid suffix -ine, forming cocaine. It is a stimulant of the central nervous system, an appetite suppressant, and a topical anesthetic...
when both food and stimulation are offered concurrently for a limited time each day. Rats will even cross electrified grids to press a lever, and they are willing to withstand higher levels of shock to obtain electrical stimulation that they are to accept for food .
Extinction
In comparison to behavior reinforced by natural reward, the reinforcing effects of self-stimulation through either electrodes or drug administration cause the behavior to be extinguished more rapidly and completely. Based on experiments with time spaced trials, Olds et al. speculated that the drive to self-stimulate is dependent on the immediate after-effects of the stimulation. Unlike brain stimulation, natural rewards provoke an innate or well-established cortical representation that can be associated with their accompanying sensory stimuli, causing them to produce expectancy-of-reward in subjects during subsequent trials. Since the electrical stimulation is an unnatural stimulus, the activating effect of the reward expectancy is diminished and therefore the behavior is subject to rapid extinction when the behavior is no longer reinforced.Satiation
An interesting feature of BSR discovered during satiation experiments in rats is that reward itself does not produce satiety. Olds demonstrated that the lack of satiation associated with laboratory rewards allows animals to self-stimulation to sheer exhaustion and that satiation is dependent on the location of the electrical stimulation. In a 48 hour satiation test, rats with hypothalamic electrodes self-stimulated to exhaustion and showed no intrinsic satiation tendencies, where as telencephalic electrodes showed radical slowing of self-stimulation after 4 to 8 hours.Addiction
This evidence helps to elucidate why some behaviors become an addictionBehavioral addiction
Behavioral addiction is a form of addiction which does not rely on drugs or alcohol. Increasingly referred to as process addiction or non-substance-related addiction ) behavioral addiction includes a compulsion to repeatedly engage in an action until said action causes serious negative consequences...
, a compulsive habit that is maintained despite harmful consequences. Laboratory rewards can establish compulsive self-administration habits of seeking and ingesting that qualify as addiction (1).Rats and monkeys have been shown to work in a compulsive manner to achieve intravenous injections of stimulants, and when access to the drugs is not limited, they will self-administer the drugs to the point of severe weight loss and death. This demonstrates that the habit of self-administration for intracranial brain stimulation or drug injections becomes compulsive almost immediately. BSR is hypothesized to be so effective in establishing compulsive habits because it bypasses the synaptic barriers in the sensory pathways to directly activate the reward pathway. The lack of delay in the reinforcement of a behavior motivated by BSR increases its effectiveness because even a delay of 1 second between the lever-press and the reward delivery can reduce its effectiveness . BSR offers insights into the neuroadaptations involved in reinforcement and addiction.
Anatomy of reward
Mapping and lesion studies on BSR were designed to determine the location of reward-relevant neurons as well as determine the signal pathways that are directly affected by brain stimulation. The site of intracranial self-stimulation leads to substantially different behavioral characteristics. Sites along the length of the medial forebrain bundleMedial forebrain bundle
The Medial forebrain bundle , is a complex bundle of axons coming from the basal olfactory regions, the periamygdaloid region, and the septal nuclei.-Anatomy:...
(MFB) through the lateral and posterior hypothalamus
Hypothalamus
The Hypothalamus is a portion of the brain that contains a number of small nuclei with a variety of functions...
, the ventral tegmental area (VTA), and into the pons
Pons
The pons is a structure located on the brain stem, named after the Latin word for "bridge" or the 16th-century Italian anatomist and surgeon Costanzo Varolio . It is superior to the medulla oblongata, inferior to the midbrain, and ventral to the cerebellum. In humans and other bipeds this means it...
are associated with the strongest reward effects of stimulation.
Lateral Hypothalamus
The lateral hypothalamusLateral hypothalamus
The lateral hypothalamus or lateral hypothalamic area is a part of the hypothalamus.It is concerned with hunger. Damage to this area can cause reduced food intake...
is a portion of the hypothalamus, and brain stimulation to this area of the reward system produces the highest response rates and subsequently the highest reward potency. Lesions in this region or along its boundary cause a loss of positive drive-reward behaviors as well as all other operant drive behaviors.
Medial forebrain bundle
The medial forebrain bundleMedial forebrain bundle
The Medial forebrain bundle , is a complex bundle of axons coming from the basal olfactory regions, the periamygdaloid region, and the septal nuclei.-Anatomy:...
(MFB) is the location of the most frequently investigated brain stimulation reward sites, and it is composed of a complex bundle of axons coming from the basal olfactory regions and the septal nuclei
Septal nuclei
The septal area are structures that lie below the rostrum of corpus callosum in front of lamina terminalis , composed of medium-size neurons grouped into medial, lateral, and posterior groups...
. MFB is not the sole anatomical substrate responsible for reinforcing brain stimulation; however, it is the main pathway for the ascending dopamine fibers and it functions to relay information from the VTA to the nucleus accumbens
Nucleus accumbens
The nucleus accumbens , also known as the accumbens nucleus or as the nucleus accumbens septi , is a collection of neurons and forms the main part of the ventral striatum...
. The rewarding effect of the MFB depends on the ability of the stimulation to activate the mesocorticolimbic dopamine system.
Mesolimbic pathway
The mesolimbic pathwayMesolimbic pathway
The mesolimbic pathway is one of the dopaminergic pathways in the brain. The pathway begins in the ventral tegmental area of the midbrain and connects to the limbic system via the nucleus accumbens, the amygdala, and the hippocampus as well as to the medial prefrontal cortex...
contains the VTA, nucleus accumbens
Nucleus accumbens
The nucleus accumbens , also known as the accumbens nucleus or as the nucleus accumbens septi , is a collection of neurons and forms the main part of the ventral striatum...
, amygdale, and the medial prefrontal cortex
Prefrontal cortex
The prefrontal cortex is the anterior part of the frontal lobes of the brain, lying in front of the motor and premotor areas.This brain region has been implicated in planning complex cognitive behaviors, personality expression, decision making and moderating correct social behavior...
. The nucleus accumbens is a part of the striatum
Striatum
The striatum, also known as the neostriatum or striate nucleus, is a subcortical part of the forebrain. It is the major input station of the basal ganglia system. The striatum, in turn, gets input from the cerebral cortex...
that integrates information from cortical and limbic brain structures to mediate behaviors the reinforce reward . The nucleus accumbens is a major target for the dopaminergic projections from the brainstem that are associated with BSR. The VTA is a group of neurons located close to the midline on the floor of the midbrain, and VTA is the origin of dopaminergic cell bodies that comprise the mesocorticolimbic dopamine system.
Modulation with drugs
When drugs are injected into the brain, they provide anatomical and neurochemical specific tools for investigating BSR. They are transported to all areas of the brain via the circulation system, and act on specific receptors that are restricted to particular classes of neurons. BSR and abusive drugs are hypothesized to activate the same brain mechanism and potentiate the rewarding effects of stimulation at the same brain sites. This is consistent with evidence that abusive drugs increase response in BSR by increasing the reward potency of the stimulation at the same brain sites and through the same mechanisms that makes the drugs rewarding. Studies using lesion, pharmacological, and anatomical mapping of the brain have revealed that many drugs of abuse (e.g. amphetamineAmphetamine
Amphetamine or amfetamine is a psychostimulant drug of the phenethylamine class which produces increased wakefulness and focus in association with decreased fatigue and appetite.Brand names of medications that contain, or metabolize into, amphetamine include Adderall, Dexedrine, Dextrostat,...
, cocaine
Cocaine
Cocaine is a crystalline tropane alkaloid that is obtained from the leaves of the coca plant. The name comes from "coca" in addition to the alkaloid suffix -ine, forming cocaine. It is a stimulant of the central nervous system, an appetite suppressant, and a topical anesthetic...
, opioids, nicotine
Nicotine
Nicotine is an alkaloid found in the nightshade family of plants that constitutes approximately 0.6–3.0% of the dry weight of tobacco, with biosynthesis taking place in the roots and accumulation occurring in the leaves...
, etc.) activate the reward circuitry of the MFB, which requires a stimulation to activate the mesocorticolimbic dopamine system. Current research focuses on the dopaminergic pathways as the substrate of brain stimulation reinforcement; however, both noradrenergic and dopaminergic pathways are important in brain stimulation reinforcement.
Dopamine reinforcement pathways
The mesolimbic pathwayMesolimbic pathway
The mesolimbic pathway is one of the dopaminergic pathways in the brain. The pathway begins in the ventral tegmental area of the midbrain and connects to the limbic system via the nucleus accumbens, the amygdala, and the hippocampus as well as to the medial prefrontal cortex...
is activated trans-synaptically by normal rewards (food, water, copulation) but it can also be activated directly by the induced rewards of intravenous drugs or electrical or chemical brain stimulation. The mesolimbic pathway is one of the dopaminergic pathways
Dopaminergic pathways
Dopaminergic pathways are neural pathways in the brain which transmit the neurotransmitter dopamine from one region of the brain to another.The neurons of the dopaminergic pathways have axons which run the entire length of the pathway...
in the brain that modulates behavioral responses to rewarding stimuli. It originates in the VTA and connects to the limbic system
Limbic system
The limbic system is a set of brain structures including the hippocampus, amygdala, anterior thalamic nuclei, septum, limbic cortex and fornix, which seemingly support a variety of functions including emotion, behavior, long term memory, and olfaction. The term "limbic" comes from the Latin...
via the nucleus accumbens, the amygdala, and the medial prefrontal cortex. A number of drugs are rewarding when they are injected into the nucleus accumbens
Nucleus accumbens
The nucleus accumbens , also known as the accumbens nucleus or as the nucleus accumbens septi , is a collection of neurons and forms the main part of the ventral striatum...
and act as mesolimbic dopamine terminals, and the axons of the mesolimbic dopamine system have high thresholds for stimulation .
Dopamine antagonists and agonists
Drugs that alter the potency of BSR in either an antagonistic or synergistic manner are predominantly dopamine antagonists and agonists. The mechanism of synergismSynergism
In theology, synergism is the position of those who hold that salvation involves some form of cooperation between divine grace and human freedom...
between addictive drugs and brain stimulation is the summation effect within or at the synapses of the mesolimbic system. Although dopamine
Dopamine
Dopamine is a catecholamine neurotransmitter present in a wide variety of animals, including both vertebrates and invertebrates. In the brain, this substituted phenethylamine functions as a neurotransmitter, activating the five known types of dopamine receptors—D1, D2, D3, D4, and D5—and their...
plays a fundamental role in the rewarding effects of brain stimulation and abusive drugs, the exact nature of it role is still unclear, and since the reward circuitry is multisynaptic, dopamine is not the only reward transmitter. Dopamine neurons play an important role in incentive motivation and reinforcement associated with electrical stimulation to the MFB. Initially, simulation of the MFB was thought to activate the dopamine fibers directly, it is now believed the stimulation at the MFB selectively activates afferent input into the dopamine system.
Cholinergic agents are rewarding when injected into the ventral tegmental area (VTA). Opiates including Mu and Delta opioids appear to have the strongest rewarding effects through afferents to the mesolimbic dopamine systems, and the presumed mechanism of action involves the disinhibition of the dopamine system by inhibition of nearby GABAergic neurons. Dopamine and opiate antagonists are competitive antagonists of BSR, and they impair the synaptic transmission of the reward signal either across the dopaminergic synapse or across a synapse in which dopamine has a modulatory function. On the other hand, drugs of abuse have been shown to synergize with BSR by reducing the BSR thresholds for amount of stimulation required as well as act to negate the effects of a reward antagonist. BSR synergistic drugs include: amphetamines, cocaine, heroin, morphine, nicotine, phenylcyclidine, mu and delta opioids, and cannabis. These synergistic drugs summate with BSR and serve as rewards themselves by elevating the dopamine concentration at forebrain dopamine nerve terminals, including the nucleus accumbens.
Clinical relevance
Mechanisms of BSR offer a tool that provides insight into the way the brain governs behavior through motivation and reinforcement, especially in regards to addictive behavior. Further studies will elucidate the mechanisms by which addictive drugs initiate their habit-forming behavior as well as enhance knowledge of the neuroadaptations that occurs within the brain as a result of electrical stimulation or chemical injection. BSR will continue to shed light on and lead to the development of therapies to treat motivational compulsions such as compulsive eating, drinking, drug use,gambling, etc. Advances in technology and the development of an intracranial stimulation implant will assist patients suffering from disorders such as obsessive-compulsive disorder and could be used to treat a variety of psychiatric conditions, including depression, by modulating the activity of the reward system.See also
- RewardBounty (reward)A bounty is a payment or reward often offered by a group as an incentive for the accomplishment of a task by someone usually not associated with the group. Bounties are most commonly issued for the capture or retrieval of a person or object. They are typically in the form of money...
- Deep Brain StimulationDeep brain stimulationDeep brain stimulation is a surgical treatment involving the implantation of a medical device called a brain pacemaker, which sends electrical impulses to specific parts of the brain...
- Behavioral addictionBehavioral addictionBehavioral addiction is a form of addiction which does not rely on drugs or alcohol. Increasingly referred to as process addiction or non-substance-related addiction ) behavioral addiction includes a compulsion to repeatedly engage in an action until said action causes serious negative consequences...
- Reinforcer
External links
- Brain Stimulation: Can Magnetic or Electrical Pulses Help You?: Targeting Misbehaving Brain Circuitry with Therapies like ECT, DBS, and TMS
- Deep Brain Stimulation: Neurosurgical Treatments Using Deep Brain Stimulation
- Drugs and The Brain: Drugs, Brain , Behavior- The Science of Addiction