A family member in the medical field recently voiced frustration about the low quality of some non-contact infrared thermometers they received. It seem that the entire batch yields consistently lower temperatures when compared to oral thermometers.
I thought that this was strange. Typically, instruments for medical use are certified for accuracy prior to shipment. Considering that these devices come with a certificate of calibration, I reasoned that they shouldn’t produce such discrepancies. Early detection of the onset of high fever is a key factor in Covid-19 patient care. The ability to accurately track body temperature is also critical in determining if a patient is contagious and would trigger decisions regarding treatment, quarantine, and use of PPE gear.
Just like in the case of a faulty car speedometer that displays lower speeds and results in speeding tickets, the usage of faulty thermometers that consistently show lower temperatures can have a detrimental effect on patients and medical staff. Considering that we are in the midst of a severe flu outbreak, I decided to take a closer look. IR thermometers are relatively simple devices that can be easily disassembled and tested, so, I spent a few hours this weekend in the lab digging into the Chinese IR thermometer mystery.
Possible Reasons for Inaccurate IR Thermometer Readings
I do considerable amount of work in the the lab and have at times ran into equipment gremlins. In most cases, there is a simple non-mystical explanation for why test equipment fails to deliver accurate measurement. In the case of an IR thermometer this can include:
- The instrument is within the actual variance of its stated accuracy
- The instrument has faulty firmware, sensor, logic circuitry, or other board components
- The instrument is not being used correctly
- There are some unusual environmental conditions that effect the measurement (i.e. humidity)
- The instrument wasn’t calibrated prior to shipment
- The instruments detection range doesn’t cover the object temperate
For the test units I selected the top of the line Chinese made IR thermometers, all in the $60-$140 price range. There are many cheaper units on the market, but, I deliberately went with the higher-end devices because they claim to have been calibrated and certified, to be “Built for Accuracy”, and be “CE FCC RoHS FDA” approved.
To keep the test conclusive, I avoided complex correlations of skin to core body temperate or evaluating the thermometer accuracy across a wide range of surfaces and temperate ranges. All of my testing was done in a controlled environment with respect to humidity and temperature and followed an identical sequence of repeatable steps.
The Testing Procedure
- The IR thermometer was kept at room temperature on the workbench where the test was conducted.
- Unit emissivity was set to the range of 0.95-0.97.
- The lens was cleaned before each measurement.
- Distance to Target ratio was kept constant and followed the manufacturer’s recommendation for each unit.
- The IR thermometer was held in a bracket and the lens was pointed at a 90° angle from the surface.
- Each IR thermometer executed 20 consecutive readings with 5 second lap between each reading.
- All measurements were taken at the same location about 1/2” off the inner canthus eye area.
All of the Chinese made thermometers exhibited a wide range of temperature values during the test and large fluctuations between each reading. They were inconsistent, fluctuating by as much as 5 degrees between consecutive readings and often erred on the colder side. The Fluke 62 Max IR thermometer performed in a consistent predictable manner and passed the ‘Ice Water’ and ‘Infrared Comparator Cup’ tests within stated tolerances. All four Chinese made IR thermometers failed to pass both of these tests.
Of note is the high-low temperature variation pattern of the Chinese made thermometers. The test sample population indicates that all four devices were able to detect the correct skin temperate of about 96F, but its unclear whey they didn’t do so in a consistent manner.
Running 100 consecutive tests on one of the Chines made thermometers (the QJ-CWQ20) shows a distinctive cyclic pattern resembling the output exhibited by some sort of a pseudorandom number generator logic. This could be some sort of a leveling function, but it could also be an attempt by the firmware writer to compensate for poor sensor performance or an evasion mechanism–The IR thermometer equivalent of VW’s dieselgate.
Evaluating the performance of the thermopile detector (the IR sensor) on all devices shows that they functioned properly and returned readings consistent with the Fluke 62 Max sensor.
Based on the consistent thermopile value readouts on all devices and the occurrence of the temperature anomalies in only the Chinese thermometers, it’s unlikely that the cyclic pattern of low and high temperature readouts is attributable to individual components and/or circuit design issues.
The four thermometers are made by different vendors, each has different components and board layouts; suggesting that this is some sort of a shared problem. And, if this is that case, then the source must be faulty logic or firmware. Either way, this is a critical bug because if the Chinese IR thermometers use these shared faulty logic or firmware, then all of them are unreliable.
More Data Points
Two additional data points that relate to the issue of faulty Chinese medical equipment are the large amount of ‘defective’ Covid-19 test kits and sub standard PPE gear sold in the west. In this context, we should also consider the possibility that these devices were shipped while knowing that they were defective. As is evident from discussions on the Chinese DingTalk platform (an Alibaba company) where one topic of conversation is deliberately lowering the IR thermometer threshold for units sold in the US. In one 178 member group chat, Zhang Xuandong, the owner of Haofeng Electronic Technology Co— an IR thermometer producer in Dongguan, Guangdong Province in China—openly talks about waging war against the US. Zhang writes:
” [Let’s] produce some faulty products and sell them to the US. They (the thermometers) should read 36.5 ºC when the actual temperature is 39 ºC. In this way, more and more American people will be infected. Let’s see if they still have people left to go to other countries to harm others!”
After one member responds with three laughing emojis, Zhang continues:
“Isn’t that a great idea? Without using one single soldier, we can make money, as well as make peace around the world.”
Another member then responds:
“No, we don’t want to make any money from the Americans. Let them help and rely on themselves.”
Image 5: The DingTalk conversation about deliberately lowering the IR thermometer threshold for units sold in the US
Regardless of the root cause of the Chinese IR thermometer’s poor performance, the fact remains that all of the tested units were faulty. So, if you need to make critical decisions about patient care, go with a quality device like the Fluke 62 Max. With the Fluke, you will get US based support, a quality warranty, and piece of mind that your thermometer will work in a consistent and predictable manner. Regardless of make and model, stay away from Chinese IR thermometers. Unless you certify the gear independently, the same advice also applies to other Chinese medical testing equipment.
References and Sources
XRVision Sentinel AI Platform – Face recognition, image reconstruction, and object classification
Note About Core Body vs. Surface Temperature
Anyone who has experimented with baking a thanksgiving turkey knows that a thermometer inserted into the center of a turkey will yield a different temperature than taking a surface measurement by using an IR thermometer. Similarly, pointing an IR thermometer at human skin will not yield a reading of 98.6°F but rather something closer to 93°F or 96°F. This reading can depend on many factors such as skin reflectivity, moisture, hair interference, etc. (A reading of approximately 98.6°F is considered ‘core’ body temperature and must be measured in a body orifice.)
Temperature Baseline Verification Procedures
As part of the IR thermometer benchmark, I’ve used the following two test procedures to establish the baseline for each device:
Ice Water Test
The purpose of this test was to determine if the IR thermometer can accurately read the water/ice temperature of approximately 32.0°F. To perform this test, I followed these steps:
- I filled a glass with crushed ice and added water to fill the gaps between the ice cubes.
- I allowed the ice/water to rest for 120 seconds.
- I stirred the mixture to get uniform distribution of water and ice.
- I attached the infrared thermometer to a holder located over the top of the ice/water at a distance of 3″ with the lens at a 90° angle and centered it over the ice/water.
- I took 10 consecutive readings at 10 second increments
Infrared Comparator Cup
The purpose of this test was to compare the accuracy of an infrared thermometer to a calibrated immersion type thermometer at a temperature other than that of ice/water. The reading of the IR thermometer should match that of the reference thermometer within the stated specifications. To perform this test, I followed these steps:
- I used a machined aluminum cup with a flat surface with a solid matte black coating. The cup walls shield the surface from air currents in the room and the mass of the base provided for temperature stability.
- I inserted the reference thermometer and allowed it to stabilize for five minutes.
- I pointed the IR thermometer at the target inside the cup using the same distance and geometry as with the Ice Water test.
- I took 10 consecutive readings at a 10 second increments
Copyright 2020 Yaacov Apelbaum, All Rights Reserved.