Our technology
Calibration & auditing
The key to achieving and demonstrating accuracy
Using calibration to maximize accuracy
A single BlueZoo sensor can accurately count multiple thousands smartphones in a detection zone, whether the small space in front of in-store signage, the medium space in around street furniture, or an enormous space such as an entire home improvement retail store or hotel ballroom.
One challenge of counting the number of phones in a space is that spaces and phones vary. Some spaces are surrounded by materials that block microwave signals (both Bluetooth low energy and Wi-Fi), while others allow microwave signals to pass freely. Some spaces have internal obstacles (e.g. metal filing cabinets), while others do not. Some spaces are round, others rectangular, and others of varying shapes. Some phones probe more aggressively and with higher power than other phones…though the variation among phones is surprisingly small and statistically of minor importance. Calibration makes accurate counting possible in these diverse environments, and auditing confirms it.
See BlueZoo’s many tutorials that describe calibration and auditing of BlueZoo sensors.
Detection zone shape and size
The space in which BlueZoo counts the presence of people is called the detection zone. For signage, the detection zone should correspond to the viewshed of the signage, the zone from which people can see the signage and recognize the brand.
The shape of the detection zone is defined by the antenna pattern of the antenna. The antenna pattern of an omnidirectional antenna is approximately spherical, while the antenna pattern of a directional antenna is approximately conical.
While the antenna pattern sets the shape of the detection zone, calibration sets the size of the detection zone. If the size of the detection zone does not match the viewshed of signage, you may be undercounting or overcounting impressions or occupancy.
Why calibrate?
The range of Wi-Fi is 300 feet with a standard (1dBi) omni-directional antenna. Very rarely do we want to measure such a large area. Most viewsheds are much smaller. The following visualization graphs counts of people within the inner perimeter (in this example 30 feet) compared to those to those beyond the inner perimeter but within a second, more distant outer perimeter (in this example to the maximum detection range of the BlueZoo Wi-Fi sensor of approximately 300 feet).
If you don’t calibrate, essentially you count every person/smartphone that the sensor can “hear”, which is almost certainly an overcount. Some vendors of passive-microwave audience measurement solutions do not permit calibration or auditing and instead offer inflated counts as a feature, not a bug.
Three types of calibration
BlueZoo offers three independent mechanisms for calibration: good, better, and best. Good calibration, known as distance-based calibration, measures the distance from the sensor’s antenna to the most distant smartphone to be detected. Using a power-distance curve (that BlueZoo has measured for every antenna type that BlueZoo provides), a user can convert distance to minimum Wi-Fi signal strength.
Better calibration, known as range-detection-based calibration, is achieved by having the BlueZoo sensor measure the strength of smartphone signal on site. An installer, typically a BlueZoo customer or a systems integrator, carries a smartphone running the BlueZoo mobile app along the perimeter of the detection zone. The sensor records the signal strength of the smartphone as received after passing through filing cabinets, plants, and any furniture that might be present. The BlueZoo cloud software calculates received signal strength along the perimeter, and allows the installer to establish a minimum signal strength empirically.
BlueZoo’s best calibration, known as ground-truth-based calibration, compares the true number of persons in a space with the Wi-Fi probes collected by BlueZoo sensors. Ground-truth-based calibration represents the gold standard and provides the technology for accuracy audits.
Ground truth-based calibration: the gold standard
Generally, installers should collect ground truth on multiple occasions, including when a space is crowded and when it is less crowded. The BlueZoo mobile app permits multiple ground truth collectors to simultaneously collect ground truth, for example at different entrances to a very large space. Our systems collate this ground truth and compare it to the values detected by our sensors to calibrate sensors for optimal accuracy. Small spaces can generally be calibrated by a single ground truth collector.
Once ground truth is collected, an administrator selects desired ground truth records and runs a calibration job to generate a series of calibration candidates. These calibration candidates combine attributes including minimum signal strength, gain, and a specific computational method. Since our founding, BlueZoo has refined a series of computational methods which reflect how people move in a half-dozen behavioral clusters. Each candidate employs one of these methods representing all similar behavioral clusters.
For each calibration candidate, BlueZoo calculates the mean square error across all sample points. These candidates take into account people with more than one phone or no phone, for example. Generally, the administrator will select the candidate that maps the sensor’s measurements most closely to the collected ground truth.
Calibrating large deployments of sensors
Each distinct sensor environment needs to be calibrated, and these calibrations can be applied to all similar sensors. For example, most retail stores have standard store layouts with standards for aisle width, department size, and check out areas. Once the combination of layout and BlueZoo sensor/antenna are calibrated, that combination of computation method, gain, and minimum signal strength can be applied in bulk to other sensor locations.
Calibration is usually performed once, but a succession of calibrations can also be performed. Sometimes, hardware installers will initially set a simple distance-based or ground-truth-based calibration for a sensor. This calibration can be refined with a ground truth calibration during periods of high and low foot traffic.
Auditing as proof of accuracy
The same ground truth collection enabled by the BlueZoo mobile app can be used for auditing. An auditor collects ground truth. But rather than use this ground truth to calibrate the sensor, the ground truth is compared to the sensor’s output to calculate the degree of accuracy. We recommend annual audits or periodic audits on a subset of sensors to record the accuracy as the physical layout of the environment evolves.
Auditing is a necessary part of any audience measurement solution. Beware of any automated measurement solution that cannot be audited.
Thanks to BlueZoo’s realtime audience measurement, auditing is possible unlike SDK-based “annual averages” that insist that advertisers simply trust the process. And thanks to our mobile apps, auditing is also easy.
Our product system
Unlock your company’s data potential
Learn how BlueZoo can deliver insights that allow you to make more informed, timely decisions and operate more cost-effectively.
Get a demo
Stay up to date!
Enter your email address below to receive periodic updates about latest features, insights and noteworthy news.