Every day, we are bombarded with new information about dogs that arises from a variety of sources – via the internet, through our smart (or not so smart) phones, from our colleagues, friends and family, and of course from our neighbor Joe next door (who happens to know a lot about dogs). In this day and age of information overload, it should come as no surprise that deciding which information is trustworthy and which to view with a healthy dose of skepticism is increasingly difficult. Lucky for dog folks everywhere, science comes to the rescue once again.
Even within science however, all evidence is not created equal. Though not quite as dramatic as walking on water, the construction of a handy “evidence pyramid” helps us to sort the various categories of scientific study and to rate the types of information that they provide.
Interpreting the Pyramid: First, keep in mind that this graphic presents only scientific evidence and does not include the host of other types of information that we come across each day, such as anecdotes, testimonials, stories/experiences, and (non-expert) opinion. (For a review of all of these types of evidence, see my new book, Dog Food Logic). As you move from the bottom to the top of the pyramid, the amount of information (published literature) decreases, but its relevance and reliability generally increases. Starting at the bottom:
- Editorial and expert opinions: Experts in a field will often produce textbooks and review papers that can provide a good foundation about the chosen topic. This information presents a helpful summary, but because it is not reporting results of a scientific study, cannot provide evidence that supports or refutes a new scientific hypothesis.
- Case reports: These are individual reports, usually published by a practicing veterinarian, of one or more dogs with a condition who are found to respond to a particular treatment. People are often surprised that case reports are not regarded as stronger scientific evidence. However, while case reports may generate new hypotheses, they cannot be used as strong support for an existing hypothesis because of their anecdotal nature and the lack of control groups (remember our Steve Series).
- Case-controlled and cohort studies: Case controlled studies occur when the researcher finds cases (dogs, in our example) that have the condition under question and then matches and compares those cases with other dogs who are similar, but lack the condition. Similarly, cohort studies compare large groups of dogs with or without a condition, over time. While providing a type of control, results of these studies are limited because showing a statistical relationship (usually correlation) between two groups does not mean than one factor necessarily caused the other.
- Randomized controlled trials (RCT): This type of study is the most important and reliable source of scientific research. It includes methodologies that use the scientific method, reduce the potential for bias (via randomization, blinding, and the use of placebos) and allows for comparison between intervention groups and carefully selected control groups.
- Systematic Reviews: At the pinnacle of scientific evidence, this is is a specific type of review in which experts in a field assess all of the relevant studies and the data (called a meta-analysis) that address a particular topic. Systematic reviews require enormous commitments of effort, time, and money and are only possible once a hypothesis has been studied in depth. Therefore, these studies are few in number, especially for many topics of that are important to dogs. (For a good source of a few systematic reviews in canine health see Best Bets for Vets).
AN EXAMPLE – THYROID ON TRIAL
An example: I recently came across a great example of a hypothesis about canine health and behavior that progressed from a few initial case reports, through case-controlled studies and culminated recently with the gold standard – the completion of a randomized, controlled trial. The issue had to do with a common endocrine disorder in dogs, hypothyroidism, and its potential relationship with aggressive behavior.
Background information: Thyroid hormone is produced by the thyroid gland. The active form of this hormone regulates cellular metabolism and so has effects in virtually all body systems. The condition of hypothyroidism refers to a reduction in thyroid hormone production and resulting clinical signs. Hypothyroidism generally develops in middle-aged or older dogs and certain breeds show a genetic predisposition. Documented clinical signs of hypothyroidism include lethargy, decreased interest in exercise, weight gain, changes to coat quality and hair loss, and skin problems such as seborrhea, hyperpigmentation and secondary bacterial infections.
Is there a relationship between hypothyroidism and aggression in dogs?
Hypothesis: In recent years, it has been speculated that certain types of aggressive behaviors in dogs may be related to suboptimal or low thyroid hormone levels. Starting with case reports, this hypothesis has gradually worked its way up the evidence pyramid:
- Case reports: Two case reports were published in 2002 and 2003. Together, they involved a total of 5 dogs with owner-directed aggression, who were subsequently also diagnosed with hypothyroidism. The dogs responded to thyroid hormone replacement therapy with a reduction in aggressive episodes, leading to the hypothesis that some cases of aggression in dogs may be associated with hypothyroidism (1,2).
- Case-controlled studies: A case-controlled report was conducted a few years later (3). Records of over 1500 dogs were reviewed. Of these dogs, 61 per cent were classified as either hypothyroid or with suboptimal thyroid function. A statistically significant correlation was found between thyroid dysfunction and dog-to-human aggression in this group of dogs (p < 0.001). However, two subsequent case-controlled studies failed to find a connection between thyroid hormone levels and behavior problems (3,4). Conflicting results – jury still out.
- The RCT: Most recently, in 2013, the connection between suboptimal thyroid hormone levels and aggression in dogs was examined using the Gold Standard of designs – a double-blind, randomized, placebo-controlled study (5). Dr. Nick Dodman and his colleagues at the Tufts Cummings School of Veterinary Medicine enrolled a group of 40 dogs, all of whom were exhibiting owner-directed aggression and were also diagnosed with suboptimal or low thyroid hormone levels. Following screening and a 2-week pre-treatment (baseline) period, the dogs were randomly assigned to either the treatment group (thyroxine replacement therapy) or to the control group (placebo). Neither the researchers nor the owners knew which group each dog was assigned to. Dogs were medicated twice daily for a period of 6 weeks. During both the baseline period and throughout the study period, owners recorded the number and type of aggressive episodes that their dog exhibited.
- Enrollment and attrition: The highly specific inclusion criteria for the dogs in this study (aggressive dogs that had borderline or low thyroid function) coupled with difficulties associated with working with dogs with aggression problems led to a relatively small initial sample size (n = 40). In addition, attrition was high, due to owner non-compliance or other problems.
- Frequency of aggressive behavior within groups: The frequency of aggressive episodes significantly decreased in both groups from baseline levels over the six-week experimental period. The change in the control group demonstrates a significant placebo effect in this study.
- Treated group vs. placebo group: Owner-measured aggression did not differ between the treated group and the placebo group during the first five weeks of the study period. During the final week of the study (week six), dogs who were treated with thyroxine and had normalized serum thyroxine levels showed slightly lower frequencies of aggression when compared with dogs who were receiving the placebo, but this difference was not statistically significant (P = 0.08).
Take away for dog folks: This type of design is truly the “gold standard” of experimental studies for several reasons:
- Methodology: An RCT design reduces bias and allows relevant comparisons because a matched control group is used, treatments are randomly assigned, and neither the experimenters nor the subjects (in this case the owners of the dogs) know which treatment each dog is receiving. In addition, the inclusion of a placebo treatment (as opposed to simply not treating the control group at all) allowed the researchers to measure and account for a placebo effect (which clearly was important in this study).
- Clinical trials using dogs in homes: This study was a clinical trial, meaning that it was conducted with owned dogs living at home with their owners. This differs from studies conducted with dogs living in kennels (typically at a university setting or at a pet food company’s kennel). If you remember back to The Steve Series, a cornerstone of the scientific method is selecting a study sample that is representative of the population that you will make conclusions about. Therefore, while we can control many of the “variables of life” with kenneled dog studies (making those studies much easier to conduct and to detect differences) , such a sample is by definition, less representative of the population of dogs than is a sample that includes dogs living at home.
Challenges: In-home clinical trials with dogs are wrought with enormous challenges, all of which make it difficult to demonstrate real effects when they exist and which can require larger sample sizes to detect any true differences. These include:
- Variations in daily life: Every owner lives with his/her dog in ways that are idiosyncratic to that person’s demographics, lifestyle, and values. These differences all impact an owner’s perceptions of his dog’s behavior (in this example, displays of aggression) as well as a tendency to show a placebo effect (see below).
- Dog differences: Generally speaking, the differences among pet dogs enrolled in a clinical trial are going to be greater (spread more widely around the mean) than those among a group of kenneled dogs. The most obvious difference is the variability in living situations and daily routines among households. These are not present when studying a group of dogs who are housed under the same conditions and experience the same daily routines. For a researcher, this means that being able to identify a treatment effect (in this case, a measurable reduction in aggressive episodes in dogs treated with thyroid hormone), is much more difficult when studying dogs in homes compared with studying dogs in kennels.
- Owner perceptions and compliance: When the owner is the data collector in a study (which is sometimes the only feasible approach with in-home studies), there will be error (variability) introduced by the different perceptions among owners as well as by varying levels of compliance. Extreme non-compliance usually leads to removal from the study, but this too is a problem since removing subjects from an already limited sample will further reduce the power of the experiment (i.e. the ability to detect a true difference when it exists).
- Placebo effects: Just as in studies with human subjects, the placebo effect is a real effect that must be accounted for in dog studies. When owners are aware that their dog is enrolled in an experimental trial, even though they are blinded to the treatment that their dog is receiving, the mere participation in the study will affect their perspective of their dog’s behavior and their judgement of possible effects or side effects of the treatment (that their dog may or may not be receiving). Including a placebo control group in a study that includes subjective measures of behavior (such as measuring the number and intensity of an aggressive response) is even more important since subjective scales are generally less reliable than objective measures.
Bottom line? The RCT that examined the effects of thyroid hormone replacement therapy on borderline or frankly hypothyroid dogs with owner-directed aggression showed a slight numerical reduction in aggression that was not statistically significant. As a result, the researchers concluded that thyroid replacement therapy could not be wholeheartedly recommended as a treatment for aggression in hypothyroid dogs and that additional studies of this type may be helpful to further examine this potential connection.
Personally, I think that this is also an excellent example of the progression of science from a set of initial case reports, followed by case-controlled studies, culminating in a randomized, controlled, clinical trial. An examination of the final study illustrates the enormous commitment of labor, time, and money that is required when conducting clinical trials as well as the importance of including placebos and double-blinding in scientific studies. Kudos to the investigators – not only for conducting what was clearly a very challenging clinical trial, but also for reporting informative negative results in a peer-reviewed journal.
Fatjó J, Stub C, Manteca X. Four cases of aggression and hypothyroidism in dogs. Veterinary Record 2002;151: 547-548.
- Dodds WJ, Aronson LP. Behavioral Changes Associated with Thyroid Dysfunction in Dogs. Proceedings 1999 American Holistic Veterinary Medical Association Annual Conference, pp. 80-82.
- Carter GC, Scott-Moncrieff JC, Luescher AU, Moore G. Serum total thyroxine and thyroid stimulating hormone concentrations in dogs with behavior problems. Journal of Veterinary Behavior 2009; 4:230-236.
- Radosta LA, Shofer FS, Reisner IF. Comparison of thyroid analytes in dogs aggressive to familiar people and in non-aggressive dogs. Veterinary Journal 2011;192:472-475.
- Dodman NH, Aronson L, Cottam N, Dodds JW. The effect of thyroid replacement in dogs with suboptimal thyroid function on owner-directed aggression: A randomized, double-blind, placebo-controlled clinical trial. Journal of Veterinary Behavior 2013;8:225-230.
21 thoughts on “Thyroid on Trial”
Pingback: Can We Make Raw Dog Foods Safe? | The Science Dog
Pingback: Wait. Should I like that? – The Science Dog
Pingback: It’s Not Rocket Science….But, it IS Science – The Science Dog
Thank you SO much for this.
I have become inreasingly concerned over teh ‘thyroid’ issue in dogs.
As someone with hypothyroidism i can assure you it does not make be cranky or inclined to be aggressive. Rather the opposite — I can’t be bothered any more 😦
Pingback: What the Dog’s Nose Knows | The Science Dog
Not knowing the timeline of drug saturation levels for meds used to treat hypothyroidism I am curious if it was a factor used in this study. Standing out to me was the statement, “During the final week of the study (week six), dogs who were treated with thyroxine and had normalized serum thyroxine levels showed slightly lower frequencies of aggression…” Could it be that the lower frequencies of aggression shown in week six, the last week of the study, are only the earliest results of the effects of the drug therapy, and subsequent weeks may increase the (P = 0.08) statistic?
Just FYI: My dog was diagnosed with hypothyroidism around age 4 & has been on meds ever since, about 3 years. No aggressive behavior before or after meds.
Hi Martie – I agree that it would have been interesting to see how these dogs were doing if the experiment was carried out for several months. Interestingly, when all of the dogs in the treated group were included in the analysis, they did see a significant effect (reduction) in aggression in the treated group when compared with the placebo group, at week 6. However, two of those dogs were removed from the treated group for analysis because their serum thyroid levels showed that they were still hypothyroid. When they were removed from the group, the reanalysis caused the comparison to slip into non-significant. (This is beyond the scope of this particular essay, but that problem – seeing a change in significance by removing just two subjects – illustrates a problem in statistics/research called “the problem of small numbers”, which basically tells us to be somewhat wary of results, even statistically significant results, that arise from studies with very small group sizes). Regardless, your point is a good one – thanks for posting. Linda Case
Your article has an excellent explanation of evaluating various kinds of studies. Relying on scientific evidence is so important in this day and age. The public has an open mind about alternative therapies, which is fine until they go over the deep end and rely on such things as homeopathic voodoo while eschewing a traditional therapy that would actually work. The pyramid is easy to understand and very informative. Thank you so much! I’m sharing it on my business facebook page.
Hi Tad – Thanks for you comments and for the share. I appreciate this, especially coming from a fellow science writer. I agree that we live in an age when looking to science and demanding evidence-based information is more important than ever before. What is exciting is that science-based information IS available to everyone today and that all interested dog folks can access this information (and can learn to sort out the trustworthy from the not-so-trustworthy).
Great review of the literature. Now if I could only get the folks over in the free-for-all dog training discussion forum that I visited to actually read your blog, the world would be a better place! Keep ’em coming!!
Thanks Leslie – I am glad you found the piece helpful! Please feel welcome to share The Science Dog on the dog training discussion site! Linda
As the owner of a hypothyroid dog, I was very interested in this work. My dog was diagnosed as an adolescent, over the protestations of people who told me that dogs didn’t develop this until middle age. She does exhibit behavior issues that may be related to having had this metabolic disturbance in puppy hood, versus later, and when I questioned Dr, Dunbar about it at a recent seminar, his opinion was that because thyroid dysfunction can produce anxiety over not feeling quite right, that puppies might be more susceptible to acquiring behaviors that could be more resistant to change. Interestingly, my human friends who suffer from hypothyroidism have confirmed that it can make you feel very weird and it can be quite unsettling until you get a diagnosis and treatment. I wonder about the verity of the statement that dogs get this in middle age, and think that there may be other cases, like my dog, where the dog had the disorder in puppy hood and may have lasting effects behaviorally that are dependent upon what period of development they were in when the thyroid started to go haywire. Just putting this out there as food for thought.
Thanks for your note; I am glad it was a topic of interest! I agree completely that there are dogs who will be diagnosed with hypothyroidism at a young age. However, according to the published literature, the most typical presentation is in middle-aged adult dogs, presumably because the underlying cause in the majority of cases is an immune-mediate thyroiditis. These stats do not mean that a young dog cannot be diagnosed with the disorder, only that most dogs are of adult age when the disorder develops. Glad to hear that your dog responded so well to replacement therapy – Best, Linda
Kudos to you. This was one of the best presentations of the evidence pyramid that I have seen. The fact that it is not an area of you expertise gives it even more power to help others evaluate evidence. Also, Dog Food Logic is great. It will definitely be a “must read” for my nutrition and weight loss clients.
Hi Ken – Thanks so much for both comments! Regarding “Dog Food Logic”……actually, my publisher should be contacting you to ask you to review the book (you get a free copy if you do! 🙂 ). I would love to have you review it if you have time and are interested! (And of course, reviews on Amazon are always helpful and are always welcomed)! Thanks for all that you do to help dogs and their people! Linda
This is magnificent. Thank you for the pyramid, the definitions, and the examples. What a great information and teaching piece. I will be referring back to this again and again. I have linked to it from my little piece for lay people on how to cite a research article.
Hi Eileen – Thanks for your comment and kind words. I am thrilled that you will use this piece and just looked at your blog and your essay “Don’t Get Mud on your Face” – An excellent source of information for researching topics! I just started following your blog and look forward to reading more of your work! Linda
Thanks, Linda. I am flattered!
Pingback: Don’t Get Mud on Your Face! Citing Research in Discussions | eileenanddogs
A couple of things, Linda. First, with all the inherent problems you list (Variations in daily life, Dog differences, Owner perceptions, Placebo effects), how can you give “Kudos to the investigators”? I’m always wary of using self-reporting as data. Also, while you make it clear that these studies are looking at owner-directed aggression, I’m wondering if you’ve found any that look at either other kinds of aggression (people-in-general, other dogs) or fearfulness. My understanding of the behavioral effects of hypothyroidism is that they’re not necessarily limited to owner-directed aggression. Finally, what do you think of Jean Dodds’ and Diana Laverdure’s book, “The Canine Thyroid Epidemic”?
Hi Dani – Thanks for your note; always nice to hear from you. I will try to respond as best I can to your questions.
1. The point of identifying the different sources of variability (called variance in stats speak) in an in-home trial was to illustrate how difficult that type of experiment is to conduct and complete. My personal experience has been with in-home research studies of nutrition/feeding in dogs and while those are by far more desirable in terms of providing a representative sample of dogs, they are tremendously difficult to conduct because, well, people don’t always do what you ask them to do, and because, by definition, dogs living in homes are going to have a lot more variability in their daily lives than dogs living in kennels. In essence, we can control many, many more variables with a group of kenneled dogs than we can control with in-home dogs, which means that the in-home dog studies inherently have more variability, making it much harder to measure true differences between the groups. These sources of variance are definitely not the fault of the researchers, rather they are just part and parcel of trying to conduct in-home trials. (One of the ways that human research accounts for these differences is to enroll very, very large samples [typically in the thousands] and then also doing some type of study design [blocking, stratifying] that helps to minimize these differences). Unfortunately, because numbers are so low to begin with in many dog studies, such techniques cannot be used or do not help with reducing error (noise). My reason for the editorial “kudos” was because I am well aware of how difficult in-home studies are to design, fund, and complete – almost impossible sometimes – and so I think that the researchers definitely deserve credit for tackling such a difficult project.
2. Being wary of self-reporting data: Yes, and you are completely correct in your wariness. In fact, whenever self-reported data are used, we must report those results in terms of (for dog studies), owner perceptions rather than as a measured and objective reality. This is why, imho, the demonstrated placebo effect was such an important result in this study. One could argue that the responses that were observed in the early case studies with five dogs may have indeed been due primarily to a placebo effect rather than to an effect of thyroid replacement per se. There really is no way to know with a case study. That said, short of living with the owners or setting up a 24-hour video surveillance throughout their homes, there was no feasible way for the researchers to measure response in these dogs. This is true for many in-home dog studies, which is why the validation of scales (for example scales that measure pain in dogs being fed a food that is meant to manage osteoarthritis, or as in this case, a scale that measures behavior) is so vitally important. (I would also add that these challenges are one of the many reasons that the work that the various Dog Cognition Labs are doing around the country is so exciting and important. They are a specific type of study that does allow objective measure of behavior and the control of many variables that are not under control with in-home studies). So, although in a perfect world we would like to be able to objectively measure everything dog and have a trained researcher doing that measuring, that is simply not possible, especially when we are studying behaviors or conditions that can only be measured in the dog’s home.
3. Thyroid and Behavior: Thanks for bringing this up, Dani. I want to emphasize that I am by no means an expert on thyroid function or hypothyroidism in dogs. Although I have been aware of the hypothesis of a connection between aggressive behavior and thyroid for several years, I had not studied this in any great depth. (Like you, we have Goldens, and so do regularly test our dogs and have found that about 50 percent of our dogs over the years have been hypothyroid and we of course treat. While not seeing aggression as an effect, we definitely see lethargy and behavior changes and so it certainly has always seemed reasonable to me that an increase in irritability or even aggression could occur in some dogs). The primary reason that I chose this topic was to illustrate what I thought was a very nice example of “science in progress”, as it showed the progression from initial set of cases up through the pyramid of evidence. For that reason, I focused only on the papers that addressed the hypothesis of a potential connection between human-directed aggression and hypothyroidism and did not report on other behavior changes that can occur with this disorder.
Thanks again for your note, Dani. My apologies for the length of my response! (I tend to “write long” as my editors constantly chastise me about……. 🙂 ).