With me joining the recent chess boom, including me playing the game as well as watching and reviewing the mini-series “The Queen’s Gambit”, some thoughts naturally arose about competition, different skill levels and ways to maintain a healthy amount of (competitive) behavior. This is an opportunity to ponder unequal starting positions, different skill levels, odds games, handicaps, also more generally fairness and equality because this generalizes from simple games to real life.
Let’s start with something commonly seen. Consider the following humorous video where monkeys are paid unequally for the same action:
For some reason we understand that the monkeys reaction makes sense. If we tried to explain what is happening, it would be fruitless to refer to a “sense of fairness” as what we are dealing are not abstractions but always some behavior. Moreover, we don’t really know the exact history of the given monkeys – it appears that grapes are already more reinforcing than cucumbers. What can probably be said that these monkeys lived together and were fed similar food – in this setting a fellow monkey getting a luxury food is an evocative stimulus for getting the same item – this is set up in the video as well. Once no reinforcement (grape) arrives we have a negative punishment situation (removal of a reinforcer). Now from classical theory we know what kind of behavioral reactions we get following this kind of punishment – we see counter-coercion (also known as counter-aggression).
Now let’s switch to another setting – one of behavioral science’s favourite animal – pigeons. I will be referring to a very fine article by John V. Keller “B. F. Skinner, K-pulses, and the Development of Paradigms of Social Behavior” in the 2019 Q1 edition of the Operants journal.
Despite the complicated title the article deals with so-called “social behavior” in pigeons. Two pigeons had to peck a button for food and only the first pigeon to 10 presses gained the reinforcement – in other words there was a competition contingency. This is what transpired by the words of the author:
In my first experiment with this schedule I saw quickly that it wasn’t going to work. One pigeon (Bart), although he was only slightly faster, was winning virtually every bout. Homer was rapidly tailing out into extinction.
Keller (2020) – B. F. Skinner, K-pulses, and the Development of Paradigms of Social Behavior
I probably shouldn’t have been surprised by this result. Pure competition often has the effect of producing permanent losers and winners in the game of life. Just ask any economist about laissez faire capitalism!
All right, no surprise here – no reinforcement, no behavior. What if we change the conditions? Why not introduce a handicap? (should we call it a “fairness measure”?):
The handicap, in this case, was an adjusting one. When a bird won a bout (i.e., received reinforcement at the end of an FR 10), its next ratio was increased by one, whereas its opponent’s ratio was lowered by one. Voila! This worked like a charm as you can see in the film clip.
Keller (2020) – B. F. Skinner, K-pulses, and the Development of Paradigms of Social Behavior
It’s clear that both birds competed on every trial with great vigor. Their individual rates approached three responses per sec and rarely did the winner’s handicap grow to more than a response or two.
Note: FR 10 means that the reinforcement schedule is a fixed ratio 10 – every tenth response is reinforced.
Are we seeing a pattern here? Access to reinforcement results in more behavior. Now if we apply this to human behavior or, returning to chess, as in the beginning of the post – playing a higher rated opponent and losing every time is not fun (i.e. behavior is not reinforced). Therefore we introduce odds games to even out the chances and ensure reinforcement to maintain behavior and fun play for both players.
Put simply, to have behavior we need reinforcement. This brings us to a very interesting idea that is the General level of reinforcement introduced by Joseph Cautela (1984). Here we will mention a related article. It discusses behavior of yet another animal species – dogs, as well as humans. The title is Understanding Depression in Dogs and Humans by Craig Mixon in the website DogScience. This is a very worthy additional read.
The author states that reinforcement is the energy that powers behavior. This is where the idea of general level of reinforcement comes in – much overall reinforcement results in a very vigorous and active organism while a low level gives a moping, sad individual – we often designate such state of affairs as “depression”. The article provides a neat connection to this blog’s leftist side:
Some celebrities receive continuous reinforcement across the board, by which I mean that they are in a position in which they can draw continuous reinforcement for absolutely everything they do. They can find people who want to listen to everything they have to say and people who will pay them just for the chance to spend time with them. For some celebrities, there is not anything they do for which they cannot find someone who will reward them in some way for doing it.
People who live their lives on a dense schedule of reinforcement tend not only to be busy, they also tend to be extremely happy.
When reinforcement falls below a certain level, people and dogs just stop responding. However, that should come as no surprise. Remember, reinforcement produces the energy that makes behavior happen. Therefore, when no reinforcement is forthcoming, lethargy soon follows. What you get, then, is an inactive organism that just tends to mope around.
When someone falls into a low energy, dysfunctional funk as a result of a thin schedule of reinforcement, that is by definition, depression.
Be they dog or human, that’s what’s happening when you are dealing with a depressed subject. They are operating under a schedule of reinforcement that is so thin that there are just not enough rewarding stimuli in their environment to keep them active and functioning effectively, not to mention happily.In that sense, many people who are depressed due to ratio strain may actually be suffering much more from a situational problem rooted in environmental factors than from a true psychological disorder in the sense that one usually thinks of such things.
Mixon (2009) – Understanding Depression in Dogs and Humans
If stated differently – “successful people” are happy not because they are busy, but rather the other way around – they are busy because they are happy. Expressed with less psychologization and more in the vein of this post (and more generally of the RBL blog) – one gets reinforcement not exactly because one acts, but rather one acts because one’s behavior is reinforced. Keep in mind the principle of selection by consequences!
Extending the discussion of basically what is equal (or at least more equal) access to reinforcements (what can be called rights), let’s visit a discussion about economic inequality, where the oft-cited economist in this blog and Greek MP Yanis Varoufakis makes insightful commentary:
You see for a while now . . . hard work can no longer be relied upon to lift people from poverty. This is the tragedy of the last 30 years.
Yanis Varoufakis (2020) – What to do about economic inequality
But let’s finish off positively. And let me convey to Larry [Summers] my kind of socialism, the kind of ideal that fires me up. It will be a sporting parallel. But it’s not going to be the Olympics. It’s going to be the national football league, your NFL. Where in the interests, remember of competition, not fairness, teams face a harsh salary cap and the best young players are forced to sign up for the weakest of teams. So by preventing the successful team from monopolizing the best players, the NFL’s constraints liberate the true spirit of competition.
The point is hopefully clear – to have vigorous and happy individuals with a great deal of behavior, as well as to ensure competition which does not lead to monopolies or oligopolies, we have to secure a society where the distribution of income and (more importantly) wealth is more equal. Could anyone argue that wealth does not provide enhanced access to reinforcement?
The societal tendencies in the global post-2008 COVID-19 economy, however, are quite the reverse – inequality is rising. Without taking care of material inequalities any proposals to fight “psychological problems” like depression or demotivation are misled – hiring additional psychologists, ensuring the work of suicide hotlines, spreading positive thinking or the “Law of attraction”, establishing happiness economics are reactionary rumblings to maintain the status quo.

