Incomplete and Inaccurate Research Reports

Scientific Validation of Herbs Part 3

Read part 1Read part 2.

3) Incomplete and Inaccurate Research Reports
Let’s consider the study design we were talking about earlier regarding Cimicifuga and hot flashes. Perhaps someone decides to run that study and finds out that a standardized extract of Cimicifuga (30 mg three times a day) does not reduce the number of hot flashes in Caucasian women that have just undergone a hysterectomy. By the time the results hit the news all you learn is that the study demonstrated that Cimicifuga doesn’t work. However, this doesn’t mean that a woman undergoing natural menopause wouldn’t see a reduction in hot flash intensity with using half that dose. The results of the study are interesting, but may not apply to you unless your situation is identical.

In addition, many people rely of scientific summaries or research abstracts for information. Unfortunately, these are often designed to be sensational or intriguing. Even if they are accurate, they are written with a world limit and a lot of information has to be left out. I have found that upon reading the full article the results are not really as clinically relevant as the abstract would lead one to believe.

Why don’t people read the full article? It is an access issue. Researchers and students have access to the full scientific reports as part of their institutional perk. For a private individuals one article can sometimes cost more than $30. There has been a shift in recent years to require research done with public funds to be accessible to the public, but it doesn’t really solve the problem of restricted access to other research. Hard to make an educated decision when you are unable to get access to the full report.

4) Research bias
Read More…

Research Flaws

The Scientific Validation of Herbs Part 2

(Read part one)

2) Research Flaws
Flawed research is really an extension of what I was just writing about. It is important to consider research flaws, because if the research used as the basis of an evidence-based practice is flawed, then people are not getting the highest quality of care. Scientifically, there is not a study out there that is flawless. Indeed, researchers get together weekly, review other people’s work, and discuss the limitations (which is an nice way of saying they tear the research apart).

Actually one of the most flawed scientific designs from a practical perspective is what is considered the gold standard of clinical research: the double-blind, randomized, placebo-controlled study. The assumption behind this research design is that substances have inherent power and efficacy and that people’s opinions, attitudes, beliefs, expectations, and intentions also have power. This research is designed to tease apart the inherent power of the drug from the inherent power of the mind. This is a worthy goal, but this research tends to devalue the mind’s power and suggest a substance’s power is more real or valid. Indeed, the placebo effect is often eluded to as an effect that is not really real or worthy of notice.

Personally, I do not understand why, once people recognized the placebo effect, researchers didn’t focus more on optimizing the inherent healing ability of the mind. If the mind is so powerful, why are we even bothering with drugs? I suppose this may have something to do with the economics of selling drugs. In addition, this type of research is just a left-over from the limiting worldview based on Newtonian physics. In Newtonian physics a drug has an action and will always produce a predictable effect. This is a comfortable idea for many people. Quantum physics supports the idea that a wide range of possibilities are possible and that we, as humans, can influence the outcome of a drug’s effect.   Explaining the world as cause and effect will eventually fall by the wayside, along with double-blind, placebo-controlled studies, as our society adopts a worldview more in alignment with quantum physics.

What is the greatest limitation of research that is based on the double-blind, randomized, placebo-controlled study? Well, it is possible that some substances are more active when combined with the mind. This important interaction is neglected in a study designed to take all human connection and intention out of the picture. Further, human variation is amazing. It is possible that people will gravitate to the right treatment for their health problem and the idea of randomly assigning them to a test group limits the broad applicability of the results. A treatment that “doesn’t work” with the population tested, may actually be the perfect cure for certain individuals that might naturally seek out that treatment.

Other common flaws in herbal research are:

Dosing does not reflect clinical practice. I’ve seen this in research on herbs versus the common cold. I, personally, can stop any cold using Berberis. The key things are starting at first onset of cold symptoms and using high and frequent doses as needed to stop symptom progression. If I start when I just feel tired, I just need a squirt or two of tincture every once and awhile. If I start after my throat feels sore, I need a squirt of tincture every half hour until my throat doesn’t feel sore, then I can cut back.

Research was done on a single herb that is usually used in combination. Or vice versa, the research tests a proprietary blend. I was taught that herbs are feeble, but that the target effect of a combination of herbs can have a bigger impact. Still, many herbs are tested using the drug model that ignores the synergistic effects of herbal combinations.

Research was done on a form of the plant not usually used clinically. Often times companies want to validate their product and they fund research on their preparation. It is common to assume that all preparations of the plant will work similarly, but that is just an assumption. It is also assumed that each batch of the plant will work similarly, but because of natural product variability, you cannot even count on that.

Natural products and extraction methods are variable. This is not really a flaw in the research, but does represent a limitation of using research reports about herbs. I used to get menstrual migraines. I was using an alcohol extract of feverfew to reduce the frequency and intensity of those headaches. It seemed to be working. Then some research was released that demonstrated that the powered herb was effective, but not an alcohol extract. I believed it and stopped using the tincture. My headaches got worse. When I resumed taking the extract I once again experience fewer headaches with milder intensity.

Botanical product not characterized. Much of the older herb research doesn’t even report if they confirmed they had the right plant or the correct part of the plant (root vs leaf vs seed, etc). Sorry, scientists make the assumption if they buy something it actually is what they think it is, but herbs are not as straightforward as chemicals. They may also neglect to explain how the plant was extracted. In addition, the chemical analysis of the plant, which is critical to determining if one batch is equivalent to another, is rarely done or reported. Again, there was an assumption that natural products have no variability.

A traditionally used herbs was tested out of context. When herbs are used as part of traditional healing systems other components, such as ritual and/or song, may be necessary to activate the herb. For instance, in Tibetan Buddhism there are mixtures of herbs that allow meditative practitioners to go for long periods of time without food. These herbs have to be activated by special words (mantras) and are used in conjunction with specific practices.

Nettles

Wild Nettles

Test subjects do not match you. The results of using an herb may differ based on the person’s lifestyle, diet, ethnicity, etc. For instance, nettles is a common nutritive herb and food. Indeed, in Britain it is sold as cream of nettles soup. In United States and United Kingdom it is considered to be completely safe to use in any quantity. It really is a food and many women use it during pregnancy because it is rich in minerals. The fresh plant is also a potent anti-histamine and perfect for allergies. I once recommended it to a pregnant friend with hayfever. She was early in her pregnancy and started having uterine cramping/contractions. Thanks to the internet, I was able to find out that nettles does have this effect on Indian women.

Delivery method is not traditional. Some of the research coming out of Europe, where use of herbs is a standard practice in medicine, uses injectable herbal extracts. The results of an injectable form may not reflect what the herb does if taken orally. One example is the treatment of Amarita mushroom poisoning using a milk thistle extract intravenously. In the United States, mushroom poisoning is treated with liver transplants. We don’t have the IV extract they have in Europe and the oral preparations will not protect a liver from Amarita mushroom poisoning. (If you are going to eat poisonous mushrooms, better do it in Europe. Think about the differences in cost and human suffering!)

Placebo used was not really inactive. It is hard to find an inert substance to match a strong tasting herb for a placebo controlled study. I’ve seen research on the common cold that used alfalfa as the placebo. Apparently the researchers didn’t know that alfalfa is an herb that is used in the treatment of the common cold. It’s not a primary defense, but it does support the body’s ability to carry waste out of the body.

Subjects can figure out if they have the placebo or herb. If the researchers pick something that is really just filler, many people can figure out they don’t have the active substance and the study is not longer “blind”. When I was at UC Davis a women enrolled in a long term study involving gingko and the prevention of Alzheimer’s called me. She was worried about developing the disease and did not want to spend years on the placebo. I told her to just open the capsule and taste the contents. It did have flavor, but she wanted to be sure it was gingko so she came over. I tasted it and assured her she was getting gingko. Opps! Study no longer placebo controlled.

Confounding factors matter. Research has shown that the color of the tablet makes a difference in psych medications. The timing of treatment also makes a difference.   Rats undergoing radiation therapy for cancer will either live or die depending on the time of day the treatment was given due to daily fluctuations in cortisol levels. Season and stage of the lunar cycle may also be important in treatment outcome. And, of course, intention and subconscious beliefs can influence treatment results.

3) Incomplete and Inaccurate Research Reports
Read more…

CREDITS:  Urtica dioica by Franz Xaver – Own work. Licensed under CC BY-SA 3.0 via Commons – https://commons.wikimedia.org/wiki/File:Urtica_dioica_1.jpg#/media/File:Urtica_dioica_1.jpg

Scientific Validation of Herbs

In the last decade or two there has been a lot of emphasis on evidence-based practices. My opinion on this focus can be best summed up by Simon Mills (a medical herbalist):

“…perhaps the fact that 90% of all scientists in history are alive today is a reflection of an age out of touch with itself.”

Operating within the construct that the only reasonable drug, herb or practice to use is one that has been validated scientifically is an incredible limitation for a number of reasons.

1) Lack of Research
First imagine everything that exists. For this example I will depict “everything”, including the entirety of knowledge, as a circle.

All that isIn the next picture, the black dots on the circle represent our present day scientific knowledge. Actually, this is probably an exaggeration, we know much less, but I wanted you to be able to see the dots. The number one limitation of basing what herb or drug to choose on scientific knowledge is the extreme lack of knowledge we have. In addition, notice how spread out the dots are. We know a little bit about a wide range of topics, but we don’t have a complete picture of the integrated whole.

scienceI personally have found very few research studies that reflect what would truly inform actual clinical practice. It is too hard and too limiting to do a study that reflects reality. Reality is too complex, so studies are designed to be simple and only ask a simple question.

Not only does the question need to be simple, it needs to be specific. For instance, “Does Cimicifuga (black cohosh) reduce hot flashes?” is too general. First, the type of extract of Cimicifuga needs to be specified and a complete chemical profile performed. Second, the dosing needs to be specified. Third, what is the population? Are we talking surgical menopause? Are we talking natural menopause. Do the women have a hot flash twice a day or ten times a day? Other considerations are the women’s ethnicity, culture, lifestyle, dietary habits, etc. Fourth, what do we consider a reduction? Will this be less instances of hot flash or a reduction in intensity? How do you measure intensity?

Studies that reflect clinically relevant question are rare. For instance, I once reviewed an excellent study on irritable bowel syndrome that compared the efficacy of a stock traditional Chinese herbal formula with a custom blended formula prescribed by a traditional Chinese medical doctor. The doctor did better than the stock formula. That validated my opinion that herbs need to matched to people, not disease names, so I liked the study.

What were the limitations of the study? Well, maybe that doctor just happened to be better than your typical doctor. Indeed, the study really only validated the one doctor, but not the idea that custom formulation based on an individual’s constitution is better. In addition, scientifically, no conclusion is considered valid unless it can be replicated by another independent researcher. This study was not repeated, as is common with herbal research. Who’s going to pay for a study that cannot be used to make a profit?

2) Research Flaws
Read more….