共查询到20条相似文献，搜索用时 265 毫秒
1.
The role of incentive learning in instrumental performance following an upshift in the degree of water deprivation was analyzed in three experiments. In Experiments 1A and 1B, rats trained to perform an instrumental action reinforced by either sucrose or maltodextrin solutions when in a low-deprivation state were shifted to a high-deprivation state and tested in extinction. This shift in water deprivation increased performance only if the animals had been exposed to the reinforcer in the high-deprivation state prior to testing. In Experiment 2, the role of the instrumental contingency in mediating the preexposure effect observed in the first two studies was examined by training rats to make two instrumental actions for different outcomes. The preexposure experience with the outcomes produced a relative increase in performance of the action reinforced with the incentive preexposed in the high-deprivation state when a choice between the two response alternatives was conducted in that state. These experiments support the conclusion that instrumental performance following revaluation of the reinforcer by an upshift in the level of thirst depends on a process of incentive learning. 相似文献
2.
The effect of food deprivation level at the time of initial exposure to a subsequent food reinforcer was investigated in two experiments. In Experiment 1, deprivation at the time of initial exposure influenced the subsequent acquisition and extinction of an instrumental response. In Experiment 2, the residual deprivation effect associated with a reduction in deprivation level occurred only when rats initially experienced the reinforcer at a high, as compared with a low, deprivation level. Results were discussed in terms of the assumption that the limits of incentive generated by a reinforcer are influenced by the deprivation state at the time of first exposure to that reinforcer. 相似文献
3.
The control of goal-directed, instrumental actions by primary motivational states, such as hunger and thirst, is mediated by two processes. The first is engaged by the Pavlovian association between contextual or discriminative stimuli and the outcome or reinforcer presented during instrumental training. Such stimuli exert a motivational influence on instrumental performance that depends upon the relevance of the associated outcome to the current motivational state of the agent. Moreover, the motivational effects of these stimuli operate in the absence of prior experience with the outcome under the relevant motivational state. The second, instrumental, process is mediated by knowledge of the contingency between the action and its outcome and controls the value assigned to this outcome. In contrast to the Pavlovian process, motivational states do not influence the instrumental process directly; rather, the agent has to learn about the value of an outcome in a given motivational state by exposure to it while in that state. This incentive learning is similar in certain respects to the acquisition of “cathexes” envisaged by Tolman (1949a, 1949b). 相似文献
4.
Hungry rats were trained to press a lever for food pellets prior to an assessment of the effect of a shift in their motivational state on instrumental performance in extinction. The first study replicated the finding that a reduction in the level of food deprivation has no detectable effect on extinction performance unless the animals receive prior experience with the food pellets in the nondeprived state (Balleine, 1992; Balleine & Dickinson, 1994). When tested in the nondeprived state, only animals that were reexposed to the food pellets in this state between training and testing showed a reduction in the level of pressing during the extinction test relative to animals tested in the deprived state. The magnitude of this reexposure effect depended, however, on the amount of instrumental training. Following more extended instrumental training, extinction performance was unaffected by reexposure to the food pellets in the nondeprived state whether or not the animals were food deprived at the time of testing. A second study demonstrated that the resistance to the reexposure treatment engendered by overtraining was due to the animals’ increased experience of the food pellets in the deprived state during training rather than to the more extensive exposure to the instrumental contingency. In contrast to the results of the first two experiments, however, a reliable reexposure effect was detected after overtraining in a final study, in which the animals were given greater reexposure to the food pellets in the nondeprived state. 相似文献
5.
Two experiments examined the effects of extended training on the development of response-reinforcer associations. Rats were trained by using various food reinforcers to make multiple instrumental responses. Subsequently, those reinforcers were devalued by being paired with a toxin. The presence of response-reinforcer associations was inferred from the decrease in the likelihood of a response following devaluation of its reinforcer. Such response-reinforcer associations are known to contribute to performance after moderate amounts of training. These experiments addressed the question of whether the contribution of those associations remains constant, increases, or decreases with more extended training. Experiment 1 found that even after a response had been extensively trained with one reinforcer, the substitution of a new reinforcer produced new associations between the response and that new reinforcer. After extended training, a response continued to acquire new associations with a reinforcer, as indexed by the impact of a devaluation procedure. Experiment 2 directly compared the contribution of reinforcers used extensively and moderately with the same response. It found that devaluation of the extensively used reinforcer more effectively reduced performance of the response, suggesting that the associations formed with additional training contribute to performance of the response. These experiments indicate that the contribution of response-reinforcer associations does not decrease but, instead, continues to grow throughout the course of extended instrumental training. 相似文献
6.
It has been reported previously that rats prefer a flavor they consumed under high deprivation to a flavor they consumed under low deprivation (Revusky, 1967). Here it was found that this preference occurs only if nutritive solutions are used and the flavors are given preceding and following eating. If flavors are given separately from the daily feeding, rats prefer the flavor given under low deprivation, whether or not a nutritive solution is used (Experiment 3). If flavors are given before and after the daily feeding, rats prefer the flavor they had under high deprivation (before feeding) more if sucrose solutions are used than if saccharin solutions are used and more on a high-deprivation test than on a low-deprivation test (Experiments 1 and 2). It was concluded that the “incentive value” of consumption is not necessarily higher under high deprivation than under low deprivation. The preference for the low-deprivation flavor obtained here may reflect a greater proportional rewarding effect of consumption under low deprivation or may reflect an aversion to the flavor consumed under high deprivation. Perhaps a small taste of flavor under high deprivation initiates responses of digestion that are unsatisfied and thus aversive, and the more so the higher the deprivation level. 相似文献
7.
Hungry rats were trained to perform two instrumental actions, one for salt- and the other for lemonflavored polycose solution. When they were sated on one of these two outcomes by prefeeding immediately prior to a choice extinction test, the action trained with the prefed solution was performed less than the other action. The subsequent experiments examined the role of incentive learning in this specific satiety-induced outcome revaluation effect. The second experiment demonstrated that the experience of consuming a flavored polycose solution to satiety enabled the state induced by polycose consumption to control the devaluation of the flavored outcome. By contrast, the third study found that, although devaluing the prefed outcome, specific-satiety treatments could induce a relative inflation in the incentive value of other food outcomes. The final two studies demonstrated an increased outcome-devaluation effect in instrumental performance when these devaluation and revaluation effects were combined. Taken together, these studies demonstrate that specific satiety treatments produce changes in outcome value that depend upon incentive learning. 相似文献
8.
John H. Hull 《Learning & behavior》1977,5(2):207-212
Experiments 1, 2, and 3 showed that food-deprived rats responding for food pellets made significantly more long-duration leverpresses than water-deprived rats responding for water drops. These experiments further showed that this difference in instrumental response topography is long-lived, and depends neither upon idiosyncrasies of the experimental chamber nor upon severity of deprivation conditions. In Experiment 4, food-deprived rats responding for food pellets made significantly more long-duration leverpresses than did either food- or water-deprived rats responding for sucrose solution. Human judges in Experiment 5 were able to correctly identify instrumental leverpress responses by rats as being for food or water based solely on previous viewings of other rats drinking water or eating food pellets. It appears that instrumental response topographies in rats vary depending principally upon the reinforcer received, and that these instrumental response topographies resemble consummatory response topographies. 相似文献
9.
In four experiments, we investigated encoding of the reinforcer in instrumental learning. We contrasted the view that the reinforcer is encoded as a consequence of the response with the position that the expectation of the reinforcer serves as an antecedent stimulus for the response. In all four experiments, a response was followed by one reinforcer in the presence of a stimulus known to elicit an expectation of a different reinforcer. In Experiments 1 and 2, we found that devaluing the consequent reinforcer reduced performance of the response more than did devaluing the expected reinforcer. In Experiment 3, we found no evidence at all for a detrimental effect of devaluing the expected reinforcer. Experiment 4 showed that a stimulus associated with a reinforcer will preferentially promote a response that has the same-consequent reinforcer rather than the same-antecedent reinforcer. These results provide further support for the view that response-reinforcer associations are the crucial product in instrumental learning situations. 相似文献
10.
Elizabeth D. Capaldi David E. Myers David H. Campbell Joan Denise Sheffer 《Learning & behavior》1983,11(1):107-115
In five experiments, rats’ preference for a flavor was greater if the flavor had previously been consumed under low rather than high deprivation. This preference was conditioned in as few as three flavor-deprivation pairings (Experiment 1), and persisted through 28 test days, half under each deprivation level (Experiment 2). Rats never preferred the flavor associated with high deprivation even when calories were increased by giving 40 ml of 8% sucrose or when caloric density was increased to the equivalent of 20% sucrose. The preference for the low-deprivation flavor was greater when saccharin solutions were used rather than sucrose solutions, but the preference did emerge when sucrose solutions were used as testing proceeded and when a lower concentration of sucrose was used. We suggest that these preferences may be a result of flavor-taste associations rather than associations between flavors and postingestive consequences, and that the taste of the solutions under low deprivation is preferred to the taste under high deprivation. 相似文献
11.
In three experiments the sensitivity of instrumental responding to revaluation of the instrumental outcome in the absence of experience with the revalued outcome was examined. Hungry rats were trained to make one response for food pellets and a different response for sucrose liquid. In Experiment 1, these responses were tested in extinction when the animals were either thirsty or hungry. A significant preference for the sucrose-trained response was observed in the test conducted under thirst but not in that conducted under hunger. In Experiments 2 and 3, the effect of experience with sucrose under thirst on the magnitude of this preference was explored. Following training of the instrumental responses in Experiment 2, half of the animals received presentations of sucrose while they were thirsty; the other half received sucrose while they were hungry. In Experiment 3, the same design was used but these sucrose presentations were made contingent on an instrumental response. Also in Experiment 3, the specificity of the sucrose-response preference to a shift to thirst was examined by testing under increased and decreased levels of hunger. The results of those experiments indicated that the sucrose-response preference is exhibited only under thirst and that exposure to the sucrose under thirst only marginally enhanced that preference. These findings suggest that instrumental responding may be modified by changes in the value of its outcome in the absence of experience with the revalued outcome. 相似文献
12.
Stimuli associated with primary reinforcement for instrumental behavior are widely believed to acquire the capacity to function as conditioned reinforcers via Pavlovian conditioning. Some Pavlovian conditioning studies suggest that animals learn the important temporal relations between stimuli and integrate such temporal information over separate experiences to form a temporal map. The present experiment examined whether Pavlovian conditioning can establish a positive instrumental conditioned reinforcer through such temporal integration. Two groups of rats received either delay or trace appetitive conditioning in which a neutral stimulus predicted response-independent food deliveries (CS1→US). Both groups then experienced one session of backward second-order conditioning of the training CS1 and a novel CS2 (CS1–CS2 pairing). Finally, the ability of CS2 to function as a conditioned reinforcer for a new instrumental response (leverpressing) was assessed. Consistent with the previous demonstrations of temporal integration in fear conditioning, a CS2 previously trained in a trace-conditioning protocol served as a better instrumental conditioned reinforcer after backward second-order conditioning than did a CS2 previously trained in a delay protocol. These results suggest that an instrumental conditioned reinforcer can be established via temporal integration and raise challenges for existing quantitative accounts of instrumental conditioned reinforcement. 相似文献
13.
Reactivity to a reward is affected by prior experience with the different reinforcer values of that reward, a phenomenon known as incentive relativity, which can be studied using the consummatory succesive negative contrast (cSNC) paradigm, in which the performance of animals that receive a 4 % sucrose solution after trials on which they were exposed to 32 % sucrose is compared with that of subjects that always receive the 4 % sucrose solution. The exploration of a novel open field can enhance or block the acquisition of associative and nonassociative memories. The effect of open field on cSNC has not yet been explored. The main result of the present study was that open-field exposure significantly modified the expression of cSNC. Exposure to an open field 1 h but not immediately before the downshift interfered with the expression of cSNC. These animals drank more of the downshifted reward than did controls that were not exposed to the apparatus, and this behavior persisted for up to three recovery trials. This phenomenon was observed even when the animals were given a more protracted preshift phase and when the discrepancy between the preshift and shift incentive values of sucrose were increased. An open field also interfered with incentive downshift when open-field exposure occurred 6 h before the downshift, and repeated exposure to the apparatus did not deteriorate this effect. The present study adds to a growing body of literature that indicates that open-field exploration can interfere with memory formation. 相似文献
14.
In two experiments, two groups of rats were trained in a navigation task according to either a continuous or a partial schedule
of reinforcement. In Experiment 1, animals that were given continuous reinforcement extinguished the spatial response of approaching
the goal location more readily than animals given partial reinforcement—a partial reinforcement extinction effect. In Experiment
2, after partially or continuously reinforced training, animals were trained in a new task that made use of the same reinforcer
according to a continuous reinforcement schedule. Animals initially given partial reinforcement performed better in the novel
task than did rats initially given continuous reinforcement. These results replicate, in the spatial domain, well-known partial
reinforcement phenomena typically observed in the context of Pavlovian and instrumental conditioning, suggesting that similar
principles govern spatial and associative learning. The results reported support the notion that salience modulation processes
play a key role in determining partial reinforcement effects. 相似文献
15.
Andrew R. Delamater 《Learning & behavior》1997,25(4):400-412
In two experiments, the possibility of outcome-selective reinstatement of conditioned responding was examined. Evidence for outcome-selective reinstatement of previously extinguished appetitively conditioned magazine responses by rats was observed in both Pavlovian (Experiment 1) and discriminated instrumental conditioning (Experiment 2) procedures. In both experiments, stimulus-elicited magazine responses occurred more in the presence of a stimulus whose reinforcer was reinstated than they did in the presence of another stimulus whose reinforcer was not reinstated. This effect was observed after both brief and extensive amounts of extinction. Outcome-selective reinstatement of instrumental leverpressing, however, was not observed, although nonselective reinstatement of magazine responding and leverpressing was obtained in Experiment 2. Overall, the data from these studies challenge existing theories of reinstatement, and they provide additional evidence of the importance of outcome-specific processes in the control of learned performance. 相似文献
16.
Richard L. Hyson Julie L. Sickel Paul J. Kulkosky Anthony L. Riley 《Learning & behavior》1981,9(2):281-286
In Experiment 1, animals poisoned following schedule-induced or prandial-induced saccharin consumption subsequently showed identical aversions to saccharin when tested under water deprivation. In Experiment 2, animals conditioned to avoid saccharin to similar levels under water deprivation were differentially affected when saccharin was subsequently presented on the baselines of schedule-induced and prandial-induced drinking. Together, these data indicate that the differential effects observed on schedule-induced and prandial-induced drinking when animals are poisoned following consumption under these two schedules do not reflect the differential acquisition of taste aversions, but instead reflect the differential tendencies to drink induced by the spaced and massed feedings. 相似文献
17.
Robert A. Rescorla 《Learning & behavior》1990,18(2):206-211
In three experiments, thirsty rats were trained to make several instrumental responses whose outcomes differed in which of two relatively inconsequential flavor features they contained. In Experiment 1, one of the features was subsequently devalued by pairing it with lithium chloride; in Experiment 2, it was enhanced in value by pairing it with sucrose. In both experiments, differences in the value of the features resulted in parallel differences in the likelihood of the responses during a subsequent extinction test. In Experiment 3, the animals chose between these responses in the presence of discriminative stimuli that had signaled the occurrence of these different features following another response. The stimuli selectively augmented the likelihood of the response with which they shared training by the same-flavored consequence. These results indicate that rats can separately encode features that differ along one dimension, both in the association between an instrumental response and its outcome, and in the association between a discriminative stimulus and that outcome. 相似文献
18.
In a series of within-subject experiments employing a two-choice delayed conditional discrimination task, pigeons chose correctly more often when kind of correct choice and kind of reinforcer were perfectly correlated than when uncorrelated. Correct choice behavior fell to chance levels when the correlation was reversed or when it was removed by using only one kind of reinforcer. Implications for mediation theories are discussed, with the conclusion being that, although the possibility that instrumental mediators are present in this situation cannot be dismissed, the overall pattern of results indicates that classical mediators are of principal importance in this type of task. 相似文献
19.
Utilization and dominance of physically separate redundant-relevant cues were measured in albino rats under moderate (18 h/day) or high (23.5 h/day) water deprivation. Cues were located on goal doors (brightness) and the floor (texture) in a two-choice discrimination apparatus. Three experiments were carried out with the following paradigms: incidental cue, redundant-relevant cue discrimination, and optional shift discrimination. Deprivation did not affect rate of acquisition of initial discrimination or cue dominance. Cue utilization, however, was inversely related to deprivation in redundant-relevant cue and optional shift discrimination tasks. These effects were limited, however. Over-training on the redundant-relevant cue task eliminated the effect. Within the optional shift situation, only animals that initially acquired a texture cue discrimination were affected by deprivation. Other factors affecting cue utilization in these experiments were also described and discussed. 相似文献
20.
In four experiments, food deprivation was varied during conditioning and testing of conditioning of flavor preferences by sweeteners. Conditioned preferences for a flavor associated with a more concentrated solution were enhanced by increased deprivation in training whether sucrose or saccharin was used when rats consumed solutions freely during training. When consumption of solutions was controlled and higher deprivation levels were used, preference for the higher concentration of sucrose was still enhanced by increased deprivation in training, but this did not occur with saccharin. We suggest that deprivation may enhance the reinforcing value of sweetness only when calories increase along with sweetness. We also suggest that deprivation can enhance flavor preference learning by increasing consumption and thereby increasing exposure to the flavored solutions. 相似文献