Module 1: The Basics of Behavior Modification

Module Overview

Hello and welcome to this course on ways to reduce unwanted, problematic, or even dangerous behavior, or to increase a desirable behavior. Before we dive into this most interesting area, it is important to make sure we all are on the same sheet of music. We will revisit what psychology and learning are, and how changing behavior fits into our field. As it is always important to understand where you came from, we will discuss several of the pioneers in the field of learning who are associated with the school of thought called Behaviorism. Behavior will then be defined, its dimensions discussed, and the field of applied behavior analysis will be described to include pertinent information any applied behavior analyst will need to gather. To round out the module, we will discuss how what is learned is shared with the broader scientific community.

 

Module Outline

  • 1.1. Defining Terms
  • 1.2. The Historical Context of Behaviorism
  • 1.3. Understanding Behavior
  • 1.4. The Field of Applied Behavior Analysis (ABA)
  • 1.5. Coordinating and Communicating in ABA

 

Module Learning Outcomes

  • Clarify how behavior modification fits into the larger context of the field of psychology.
  • Identify historical figures and events pertinent to learning and behavior modification.
  • Define and describe the characteristics of behavior.
  • Clarify how the field of applied behavior analysis goes about changing behavior and describe the ABCs of behavior.
  • Identify pertinent professional societies and peer-reviewed journals in the area of ABA.

 

1.1. Defining Terms

Section Learning Objectives

  • Define psychology.
  • Define learning.
  • Clarify the role of memory.
  • Contrast self-regulation and self-control.

 

To start things off, let’s take a step back in time. Behavior modification is an area under the field of psychology. Think back to when you took your introduction to psychology course. How did the text, and your professor, define psychology? If you cannot remember, how would you define psychology now that you have likely taken several psychology courses? After giving this some thought, look at the official definition.

Psychology is the scientific study of behavior and mental processes.

Let’s examine this definition before we go on.

  • First, psychology is scientific. Yes, that is correct. Psychology utilizes the same scientific process or method used by disciplines such as biology and chemistry. We will discuss this in more detail in Module 2, so please just keep this in the back of your mind for now.
  • Second, it is the study of behavior and mental processes. Psychology desires to not only understand why people engage in the behavior that they do, but also how. What is going on in the brain to control the movement of our arms and legs when running downfield to catch the game winning touchdown, what affects the words we choose to say when madly in love, how do we interpret an event as benign or a threat when a loud sound is heard, and what makes an individual view another group in less than favorable terms? These are just a few of the questions that we ask.

For the student taking a class in behavior modification, we might say that we seek to study, scientifically of course, behavior, but in terms of ways to change it for the betterment of not only the person, but all around him or her. We will spend a lot of time examining behavior in this way but do note that we will touch on cognitive processes because at times, it is not a specific action that we need to change, but the way we think about it. For instance, you might want to reduce procrastination, eliminate unnecessary anxiety, change a maladaptive cognition, or reverse a particularly bothersome habit. More on this later in the book.

So our discussion focuses on the scientific study of behavior and specifically the cognitive process of learning. What is learning then?

Learning is any relatively permanent change in behavior due to experience and practice.

Learning is key to any study of behavior modification. In fact, as you will see shortly, it is based on the model of learning developed by B.F. Skinner about 90 years ago and going back over 100 years if you consider the work of John B. Watson. If we make an undesirable behavior, we continue doing so because it in some way produces favorable consequences for us. We have learned to associate the behavior with a reinforcer such as if we wake up in the morning and instead of going to the gym, we get on our phone. Of course, getting exercise is beneficial in many ways, but we choose to surf the internet, play a game, respond on Facebook, or make a tweet instead. Why? We enjoy doing so and love it when people like our posts. The undesirable behavior is using our phone and the consequences are the enjoyment we feel and our contributions being liked or shared by others.

Fortunately, learning is only a relatively permanent change in behavior. Nothing is set in stone and what is learned can be unlearned. Consider a fear for instance. Maybe a young baby enjoys playing with a rat, but each time the rat is present a loud sound occurs. The sound is frightening for the child and after several instances of the sound and rat being paired, the child comes to expect a loud sound at the sight of the rat, and cries. What has occurred is that an association has been realized, stored in long term memory, and retrieved to working memory when a rat is in view. Memory plays an important role in the learning process too and is defined as the ability to retain and retrieve information. The memory of the loud sound has been retained and retrieved in the future when the rat is present. But, memories change. With time, and new learning, the child can come to see rats in a positive light and replace the existing scary memory with a pleasant one. This will affect future interactions with white rats.

In some cases, we adjust our behavior based on feedback we receive from others. Joking around with our significant other after he or she had a long and hard day at work will be perceived differently than a day in which he/she received an exemplary performance evaluation and a raise. Or the feedback may come from ourselves, such that we stop working out because we notice our heartrate has reached dangerous levels or we turn off the television because we are distracted. Our ability to carefully consider our actions and the effect they have on others or ourselves, and to make such adjustments, is called self-regulation. We self-regulate or self-direct more than just our actions. We can also control our thoughts, feelings, attitudes, and impulses. You might think of self-regulation as a form of behavior modification but in the short term. It could be long term too. To lose weight, we need to exercise on a regular basis, watch what we eat, manage our stress, and get enough sleep. A few days of doing this will not produce the results we seek. We need to stay committed for many months or even years.

This leads to the topic of self-control and avoiding temptations. It takes a great deal of willpower to not sleep in, get fast food for dinner, stay up late watching Netflix, or let demands in our environment overwhelm us. This is sometimes called brute self-control (Cervone, Mor, Orom, Shadel, & Scott, 2011) and if it goes on for too long can leave us in a weakened state and cause giving in to our desires (McGonigal, 2011). More on this later. For now, let’s move on to understand a brief history of behaviorism.

 

1.2. The Historical Context of Behaviorism

Section Learning Objectives

  • List the three stages of behaviorism.
  • Describe the work of Pavlov and Thorndike.
  • Describe the work of Watson.
  • Clarify how Watson changed the way psychologists studied human beings.
  • Describe the work of Skinner and Tolman.
  • Describe the work of Bandura.

 

Psychology’s past has included several major schools of thought, or a group of people who share the same general theoretical underpinning, use similar research methods, and address most of the same questions. Historically, these schools have included structuralism, functionalism, psychoanalysis, Gestalt psychology, humanistic psychology, positive psychology, cognitive psychology, and evolutionary psychology. Behaviorism, as the ninth, is the school of thought that was dominant from 1913 to 1990 before being absorbed into mainstream psychology and focused on the prediction and control of behavior. It went through three major stages – behaviorism proper under Watson and lasting from 1913-1930, neobehaviorism under Skinner and lasting from 1930-1960, and sociobehaviorism under Bandura and Rotter lasting from 1960-1990. Before we dive into these stages let’s briefly discuss two influential figures who affected the earliest stages of behaviorism. Then we will discuss each stage and its key figures who have contributed to behavior modification as it exists today.

 

1.2.1. Antecedent Influences

Ivan P. Pavlov (1849-1936). In 1904, Pavlov received the Nobel Prize for his research on digestion, but for the field of psychology, he is noteworthy for his discovery of conditioned reflexes (Pavlov, 1927), or reflexes that are dependent on the formation of an association between stimulus and response. Of course, you likely know of Pavlov’s dogs and how he stumbled upon this discovery haphazardly. He noticed that the dogs would begin salivating before the food was placed in their mouth. They did so at the sound of a bell ringing, sight of the food, or upon hearing footsteps in the hallway. They made a connection between these neutral stimuli and getting food, which led to the salivation response. More on this in Module 6.

Edward Lee Thorndike (1874-1949). Influential on the development of Skinner’s operant conditioning, Thorndike proposed the law of effect (Thorndike, 1905) or the idea that if our behavior produces a favorable consequence, in the future when the same stimulus is present, we will be more likely to make the response again, expecting the same favorable consequence. Likewise, if our action leads to dissatisfaction, then we will not repeat the same behavior in the future. He developed the law of effect thanks to his work with the Puzzle Box. Cats were food deprived the night before the experimental procedure was to occur. The next morning, they were placed in the puzzle box and a small amount of food was placed outside the box close enough to be smelled, but the cat could not reach the food. To get out, a series of switches, buttons, levers, etc. had to be manipulated and once done, the cat could escape the box and eat some of the food. But just some. The cat was then promptly placed back in the box to figure out how to get out again, the food being its reward for doing so. With each subsequent escape and re-insertion into the box, the cat became faster until he/she knew exactly what had to be done to escape. This is called trial and error learning or making a response repeatedly if it leads to success. Thorndike also said that stimulus and responses were connected by the organism which leads to learning. This approach to learning was called connectionism.

 

1.2.2. Stage 1: Behaviorism Proper (1913-1930)

John B. Watson. Behaviorism began as a school of thought in 1913 with the publication of “Psychology as the Behaviorist Views It” in Psychological Review (Watson, 1913). It was Watson’s belief that the subject matter of psychology was to be observable behavior and he is most famous for his Little Albert experiment in which he and his graduate student, Rosalie Rayner, conditioned Albert to be afraid of a white rat by pairing the sight of the animal with hearing a loud sound. This was described earlier in the discussion of learning being relatively permanent and will be covered in more detail in Module 6 when we discuss respondent conditioning. Watson also described three unlearned emotional response patterns inherent in all people (fear, rage, and love). All other emotions arise from these basic emotions via conditioning and so are called conditioned emotional responses.

What is maybe most fascinating about Watson’s influence is that he was able to change how psychologists studied human beings. Instead of a study of behavior and mental processes, Watson shaped psychology to be simply a study of behavior, and its prediction and control. This shift began in 1913 and would remain this way for almost five decades. This is not to say that all psychologists renounced cognitive studies. The Gestalt psychologists kept the flame of cognitive processes at least somewhat going; a flicker at best. It is beyond the scope of this class, but if you take a class in the history of psychology you will quickly discover that why Watson was able to do this was not rooted in psychology or even science, but within the discipline of philosophy and the worldview of mechanism.

 

1.2.3. Stage 2: Neobehaviorism (1930-1960)

B.F. Skinner (1904-1990). Skinner developed operant conditioning, discussed schedules of reinforcement, and the process of shaping by successive approximations (Skinner, 1953). His work was the foundation for behavior modification (Skinner, 1938) and will be covered in detail throughout this textbook.

Edward Chance Tolman (1886-1959). Tolman proposed the idea of purposive behaviorism or goal-directed behavior (Tolman, 1932) such as a rat navigating a maze with the intent to make it to the goal box where water is at, or a cat trying to escape Thorndike’s puzzle box to obtain nourishment. He also proposed the idea of cognitive maps, proposed a cognitive explanation for behavior, described intervening variables or unobserved factors that are the actual cause of behavior, and rejected Thorndike’s law of effect. These accomplishments make him a forerunner of contemporary cognitive psychology.

 

1.2.4. Stage 3: Sociobehaviorism (1960-1990)

The timing of the development of sociobehaviorism is rather interesting. Coming almost 50 years after the start of behaviorism, it rose and flourished during the cognitive revolution in psychology. Lead by Julian Rotter, famous for the concept of locus of control, and Albert Bandura, discussed below, the sociobehaviorists rejected Skinner’s dismissal of cognitive processes and proposed a social learning theory. The third stage of behaviorism occurred at the same time that humanistic and cognitive psychology reshaped how psychologists studied people and brought back the study of the mind.

Albert Bandura (1925-). Bandura is most well-known for his Bobo Doll experiment and the social cognitive theory. He criticized Skinner for not using human beings in his experiments and for focusing on single subjects and mostly rats and pigeons. Since people do not live in social isolation, we must not ignore these social interactions. His approach allowed for the modification of behaviors society saw as abnormal. His brand of behavior modification focused on the fact that people model or learn by observing others. As we learn undesirable behaviors in this way, we can unlearn them as well. More on this in Module 6. He also proposed the concept of self-efficacy which we will discuss in Module 3 (Bandura, 1982) and vicarious reinforcement, or the idea that we can learn by observing others and seeing what the consequences of their actions are.

 

1.2.5. Final Thoughts

We will discuss respondent conditioning (Pavlov and Watson), operant conditioning (Skinner and Tolman), and social learning theory/observational learning (Bandura and Rotter) throughout this course, and how the various procedures each learning model has developed can be used to modify human behavior. More on this later.

 

1.3. Understanding Behavior

Section Learning Objectives

  • Define and exemplify behavior.
  • List and define the four dimensions of behavior.
  • Differentiate overt and covert behavior.
  • Describe how behavior impacts the environment.

 

The focus of psychology is the scientific study of behavior and what causes it (mental or cognitive processes), while the focus of applied behavior analysis is changing behavior. So what forms does behavior take? Take a look at Table 1.1 for some examples.

 

Table 1.1. Types of Behavior People Engage In

From the table above, you can see that behavior is what people do, say, or think/feel. Behavior has several dimensions that are important to mention. They include:

  • Frequency – This is how often the behavior occurs.
  • Duration – This is how long the behavior lasts.
  • Intensity – This is how strongly the behavior occurs.
  • Latency – This is the time from when a stimulus presents itself and a behavior follows.

For any behavior we engage in, some number of these dimensions are important. For instance, if we see ourselves as worthless, often a sign of depression, we need to figure out how long the feelings have gone on for and how intense they have become. If the thoughts (and related symptoms) occur for a short duration but are intense, this is characteristic of Major Depressive Disorder. If they last a long time (long duration) but are not very intense, this is characteristic of dysthymia or mild depression. What about running? We need to know how often we run each week, how long we run, and at what speed – the dimensions of frequency, duration, and intensity respectively. Finally, consider a father asking his son to take the trash out as I often do with my son. If it takes him 15 minutes to do so then this is the latency.

Behavior can be overt or covet. Overt is behavior that is observable while covert behavior cannot be observed. We might even call covert behavior private events. When a behavior is observable, it can be described, recorded, and measured. This will be important later when we talk about conducting a functional assessment in Module 5.

Behavior also impacts the environment or serves a function. If we go to the bathroom and turn on the water, we are then able to brush our teeth. If we scream at our daughter for walking into the street without looking, we could create fear in her or raise her awareness of proper street crossing procedure.  In either situation, we have impacted the environment either physically as in the example of the faucet or socially as with the street incident. Here’s one more example you might relate to – your professor enters the classroom and says, “Put away your books for a pop quiz.”

 

1.4. The Field of Applied Behavior Analysis

Section Learning Objectives

  • Contrast pure and applied science.
  • Describe the ABCs of behavior.
  • Identify a few of the keys to bringing about behavior modification.
  • Define self-management or self-modification.

 

Science has two forms – basic (or pure) and applied. Basic science is concerned with the acquisition of knowledge for the sake of the knowledge and nothing else while applied science desires to find solutions to real-world problems. You might think of it like this – the researcher decides on his own question to investigate in pure science, but an outside source identifies the research question/problem in applied science. Of course, this is not always the case. In terms of the study of learning, the pure/basic science approach is covered under the experimental analysis of behavior, while the applied science approach is represented by applied behavior analysis (ABA). This course represents the latter while a course on the principles of learning would represent the former. We will discuss applied behavior analysis and behavior modification in the rest of this book.

So what is applied behavior analysis all about? Simply, we have to first undergo an analysis of the behavior in question to understand a few key pieces of information. We call these the ABCs of behavior and they include:

  • Antecedents – These are the environmental events or stimuli that trigger a behavior. If your significant other does something nice for you and you say, ‘Thank you,’ the kind act is the antecedent.
  • Behaviors – Again, this is what the person does, says, thinks/feels. In the previous example, you saying, ‘Thank you,’ is the behavior or what you said. The behavior may be something we want to increase, and so is classified as a behavioral deficit, or something we need to decrease and is a behavioral excess. As we will discuss later, we will have desirable and undesirable behaviors we engage in. The undesirable serves as temptations and distracts us from our end goal.
  •  Consequence – You might say a consequence is the outcome of a behavior that either encourages it to be made again in the future or discourages its future occurrence. If we always engage in a particular behavior when a specific stimulus is present, then there must be some favorable outcome that follows the behavior, thereby reinforcing its occurrence and making it highly likely that the behavior will occur the next time the antecedent is present. Hence why we say that the antecedent is a trigger for the behavior.

Let’s say that whenever Steve’s friend, John, is present he misbehaves in class by talking out of turn, getting out of his seat, and fails to complete his work. John laughs along with him and tells stories about how fun Steve is to the other kids in the 6th grade class. John is the Antecedent for the unruly Behavior, and the approval from Steve’s peers is the Consequence. Now consider for a minute that Steve is likely getting in trouble at both school and home, also a consequence, but continues making this behavior. We might say that the positive reinforcers delivered by John and his peers are stronger or more motivational for Steve than the punishment delivered by parents and teachers.

In this case, the school and parents will want to change Steve’s behavior in class as it is directly impacting his grades but also the orderliness of the classroom for the teacher. In making this plan, all parties involved will want to keep a few basic principles in mind:

  • The behavior will need to be measured both before and after any treatment is implemented.
  • Whatever treatment is decided upon by the applied behavior analysist, everyday people in the child’s life will have to implement it. Why? The therapist cannot be present 24/7 but parents and other caregivers, teachers, administrators, babysitters, etc. will be. In fact, none of these people are present 24/7 and so it will take a coordinated effort of several stakeholders to bring about behavior change. I guess it really does take a village to raise a child, or in this case to help change/establish a behavior.
  • The behavior to be changed must be defined precisely. We will cover this in much more detail in Module 4.
  • Controlling variables, or the events in Steve’s environment that are related to the behavior in a functional way, need to be considered.

If these four principles are addressed, then a sound treatment plan can be developed and implemented to bring about positive change in Steve’s behavior.

This is a great example of behavior modification at work to change the behavior of others but please note that the same principles and procedures can be implemented by an individual to bring about their own change. This is called self-management or self-modification. The final project in this course will be a self-management project and show you how to apply what you are learning to reducing an unwanted behavior or increasing some desirable one. Self-management, therefore, can be simply described as behavior modification applied to ourselves. More on this throughout the book.

 

1.5. Coordinating and Communicating in ABA

Section Learning Objectives

  • Clarify what it means to communicate findings.
  • Identify professional societies in ABA.
  • Identify publications in ABA.

 

One of the functions of science is to communicate findings. Testing hypotheses, developing sound methodology, accurately analyzing data, and drawing cogent conclusions are important, but you must tell others what you have done too. This is accomplished via joining professional societies and submitting articles to peer reviewed journals. Below are some of the societies and journals important to applied behavior analysis.

 

1.5.1. Professional Societies

  • American Psychological Association à Division 25: Behavior Analysis
    • Website – http://www.apa.org/about/division/div25.aspx
    • Mission Statement – “Division 25: Behavior Analysis promotes basic research, both animal and human, in the experimental analysis of behavior; it encourages the application of the results of such research to human affairs, and cooperates with other disciplines whose interests overlap with those of the division.”
    • Publication – Division 25 Recorder, published semi-annual
    • Other Information – “The division participates in the APA annual convention, sponsoring individual speakers, symposia, and special events, such as receptions and an annual dinner. Div. 25 is also an active co-sponsor of social hours and presentations dealing with the field of behavior analysis.”

 

  • Association for Behavior Analysis International (ABAI)
    • Website – https://www.abainternational.org/journals.aspx
    • Mission Statement – “Since 1974, the Association for Behavior Analysis International (ABAI) has been the primary membership organization for those interested in the philosophy, science, application, and teaching of behavior analysis.”
    • Publication – Inside Behavior Analysis – Newsletter publishes articles of interest to members.
    • Other Information – Offers job placement services, “Events that promote dissemination of the science and provide continuing education opportunities for practitioners,” affiliated chapters, and special interest groups.

  

  • Society for the Quantitative Analyses of Behavior
    • Website – https://www.sqab.org/
    • Mission Statement – “The Society for the Quantitative Analyses of Behavior (SQAB) was founded in 1978 by M. L. Commons and J. A. Nevin to present symposia and publish material which bring a quantitative analysis to bear on the understanding of behavior.”
    • Publication – Behavioural Processes
    • Other Information – “The International Society holds its annual meeting in conjunction with the Association for Behavior Analysis International (ABAI). Talks at SQAB focus on the development and use of mathematical formulations to: characterize one or more dimensions of an obtained data set, derive predictions to be compared with data, and generate novel data analyses.”

 

1.5.2. Publications

 

 

 

 

 

  • Journal of the Experimental Analysis of Behavior

 

  • European Journal of Behavior Analysis
    • Website: http://ejoba.org/
    • Published by: Norwegian Association for Behavior Analysis
    • Description: The European Journal of Behavior Analysis “is primarily for the original publication of experimental reports and theoretical/conceptual papers relevant to the analysis of the behavior of individual organisms.”

 

  • Behavioural Processes
    • Website: https://www.journals.elsevier.com/behavioural-processes/
    • Published by: Society for the Quantitative Analyses of Behavior
    • Description: “Behavioural Processes is dedicated to the publication of high-quality original research on animal behaviour from any theoretical perspective. It welcomes contributions that consider animal behaviour from behavioural analytic, cognitive, ethological, ecological and evolutionary points of view.”

  

Module Recap

Psychology is the scientific study of behavior and mental processes and at times our study needs to focus on how to change behavior for the better. Behavior is anything that we do, say, or think/feel and this behavior could be an excess or deficit. To determine the proper treatment strategy, we need to first figure out what triggers the behavior, or what the antecedents are, and then what maintains the behavior, or what the consequences are. Behavior modification strategies can be applied to others, but we can also apply them directly to ourselves via self-management. Once we have developed a successful treatment plan, it is important to disseminate the information to others via professional societies and peer-reviewed journals.

In the next module, we will tackle the issue of how behavior analysis and modification is actually scientific.

License

Icon for the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License

Principles of Behavior Analysis and Modification Copyright © 2020 by Lee W. Daffin Jr. is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License, except where otherwise noted.

Share This Book