Story
Reward System Notes
How Bio Psych Changed My Life
This is the study of what it means to be awake, semi-awake, and asleep.
Classical Conditioning Notes
Here are my notes on this topic:
1. People
- Ivan Pavlov
- Pavlov’s dogs
- food produces salivation
- neutral stimulus produces some salivating
- multiple pairing (50+)
- bell, click, etc.
- Watson
- psychology as science
- Morgan’s canon
- behaviorism
- black box
- white rat psychologist
- Little Albert
- fear is classically conditioned
- stimulus discrimination: respond to one stimulus but not another
- higher-order conditioning: CS functions as UCS
- Bekhterev
- father of objective. psychology
- hippocampus & memory
- Bekhterev’s disease (ankylosing spondylitis)
- killed by Stalin?
2. Components
- Reflexes
- Associated stimuli elicit a response
- reflex plus triggering stimulus produces reflex-like response
- phobias: irrational fears
- claustrophobia
- PTSD
- low level processing
- Classical Conditioning
- unconditioned stimulus (UCS)
- unconditioned response (UCR)
- conditioned stimulus (CS)
- conditioned response (CR)
- Sometimes, the UCR and the CR can be the same level
- conditioning happens gradually.
- trial: any pairing of stimuli
- examples: elevators, emotional response (shoes), smell, arousal, and drugs
- acquisition stage
- extinction
- spontaneous recovery
- stimulus generalization
3. Timings
- order of presentation
- forward conditioning
- simultaneous conditioning
- backward conditioning
- trace conditioning
- inter-stimulus interval (ISI)
4. Latent Inhibition
- unfamiliarity
- blocking
- size
- stimulus generalization
- connections are strong
- discrimination
- experimental neurosis
- reinforcement
- associations, not substitutions
- limbic system
- limits
5. Spontaneous Recovery
- extinction
- spontaneous recovery
- reinstatement
Avoidance & Escape Notes
Here are my notes on this topic:
1. Applied Classical Conditioning
- Watson
- Little Albert
- J. Walter Thompson Advertising
- Ponds cold cream
- Maxwell house “coffee break”
- pestimonials
- Pebeco toothpaste
- seduction, smoking is okay if use Pebeco
- Advertising
2. Aversion Learning
- Avoidance : stopping from doing (I control)
- Aversion: Strong dislike or disinclination (external control)
- Taste Aversion
- Fairly common
- Sushi
- Chemotherapy: associate drug nausea with food
- Toxic, poisonous or spoiled food
- Operant or classical conditioning?
- Not require cognitive awareness
- One trial
- Long time between $ and effect
- Hot dog at lunch, sick at night
- Garcia, John
- Garcia effect
- Coincidental, not food caused
- Rats given sweetened water before radiation
- 3 groups
- No radiation chose sweet. 80%
- Mild radiation mix 40%
- Strong radiation tap 10%
- Choice of sweetened or tap water
- Moral: stimulus used in classical conditioning matters
- An internal stimulus produced an internal response while an external stimulus produced an external response; but an external stimulus would not produce an internal response and vice versa
- Seligman
- Sauce-bearmaise syndrome
- Risk Aversion
- Prefer outcomes with low uncertainty
- Even if can get more reward
- More predictable but less profitable
- Rotter
- Behavior = likelihood and size of reward
- Kahneman & Tversky
- Tend to avoid risk if choice is between gains
- Seek risks when choice is between losses
- For example, most people prefer a certain gain of 3,000 to an 80% chance of a gain of 4,000. When posed the same problem, but for losses, most people prefer an 80% chance of a loss of 4,000 to a certain loss of 3,000.
- Brain
- Risk aversion in right inferior frontal gyrus
- Deal or No Deal
- People are more risk averse in limelight
- Investors
- Investors trade more frequently and more speculatively with online trading (instead of phone)
- Loss Aversion
- Prefer avoiding losses
- Loss preceeds loss aversion
- Previously experienced (loss)
- Start another relationship after breakup
- Expected to happen (risk)
- Loss aversion is twice as strong as risk
- Much worse to lose $100 than satisfaction of winning $100
- Expectations
- belief about an outcome; can create loss aversion even if nothing bad has happened
- Framing
- $5 discount or as a $5 surcharge
3. Avoidance Learning
- Bad experience
- Don’t go back
- Put on sun glasses before going out
- Avoidance parados: no stimulus, so what maintains behavior
- Discriminated avoidance experiment
- Neutral stimulus (light) is followed by aversive (shock)
- Press lever to prevent aversive stimulus: avoidance
- Free-operant avoidance learning
- No neutral stimulus
- Periodically gets shock unless press lever periodically
4. Escape Learning
- Bad experience
- Get out
- Behavior terminates aversive stimulus
- Cover eyes, cover ears, leave location
- Negative reinforcement
- Neutral stimulus (light) is followed by aversive (shock)
- Press lever to terminate aversive stimulus: escape
5. PTSD
- Mental disorder?
- Traumatic event occurs
- Most don’t have symptoms
- War: 75% no symptoms
- Any person
- Any age
- Symptoms after event
- Symptoms within first 3 months
- Flashback: relive episode
- Disorder: cause disruption
- Longer than month
- Heredity?
- Twins in Vietnam war, more likely
- Smaller hippocampus more likely
- Heightened startle response
- Brain
- High levels of cortisol, can’t reset
- Low levels of serotonin (regulate emotion)
- Low levels of dopamine (what’s important)
- Less active ventromedial areas (regulation of emotion)
- Smaller hippocampus (emotional memories not processed)
- May self-medicate with drugs and alcohol
- Shell shock
- Combat neurosis
Behavioral Change Notes
Here are my notes on this topic:
1. Clicker Training (behavior modification)
- Karen Pryor
- Positive reinforcement
- No punishment
- Shaping
- Classically conditioning to link clicker & primary reinforcer
- Not Lure
- Animals
- zoos
- horses
- dogs & cats
- Humans
- gymnastics
2. Systematic Desensitization
- Joseph Wolpe
- Incompatible response
- Anxiety stimulus hierarchy
- Relaxation & coping skills (Hierarchy of fear)
- Systematic exposure to stimuli while relaxed
- Raise finger
3. Applied behavior analysis
- What’s In A Name
- Behavior modification
- Less attention to context and behavior-environment interactions
- Behavior engineering
- Applying empirical approaches to changing behaviors
- Uses respondent and operant conditioning
- 3 versions
- 1. Radical behaviorism (philosophy of science): Skinner
- 2. Experimental analysis (basic research)
- 3. Applied behavior analysis
- Assess context
- Targeted behavior
- Environment
- Interactions
- Used in
- Animal behavior
- Positive behavior is school
- Autism
- Rehab of brain injuries
- Fitness training
- Substance abuse
- Phobias
- Organizational behavior management
4. Acceptance & Commitment Therapy (ACT)
- Increase psychological flexibility
- Steven Hayes
- Comprehensive distancing
- Focuses acceptance and comment therapy (FACT)
- Move toward valued behavior
- Open up to unpleasant feelings
- Learning not to overact
- Learn to not avoid situations
- Positive spiral
- Just notice, accept, embrace
5. Organizational Behavior Management
- Contingency management
- Analyze antecedent (triggers)
- Influencing actions
- Consequence
- Based on programmed instruction
- Owen Aldis (Of Piegeons and Men); reinforcement schedules
- Task clarification (use memos, checklists), signs
- Consequence interventions (feedback on performance)
- Reinforcement
