Introduction

This section is for new and potential partners who are looking into specifying an automatic people counting system for their own sites and projects, and are considering using the Irisys Vector devices.

Here we discuss Vector accuracy testing only.

Any decisions to be made based on value for money, cost of ownership, ease of installation, etc. are yours and yours alone. 

Notes for system specification

Different counting devices use different sensing and detection mechanisms, each with their own advantages and disadvantages.

The main advantage of Vector devices is that they use latest technology time of flight technology. This, in combination with Irisys' own tracking algorithms, make them extremely capable of tracking people and - as long as they are configured correctly - this makes them extremely accurate. Irisys quotes a 99.5% counting accuracy when devices have been installed and configured correctly.

Another advantage of Vectors is that they do not use video based tracking techniques. Counters that do, can be a problem (perceived or not) with regards to privacy. Vectors do have a video component in order to be able to see what the device is doing and how it is performing - and so that you can see what needs to be configured - but once working correctly, the video can be permanently disabled with a lens cap if required.

Because Vectors do not use video, and instead use Time Of Light sensing, counting accuracy is unaffected by varying light levels and they be used in low light levels, and even in compete darkness, if required.
See the Network and Security section for more details of the GDPR and PCI compliance and the usage of video images.

Accuracy Testing

Most potential partners will insist of doing their own accuracy testing before committing to a large expensive rollout, and this is to be expected.

But it is important to understand that the accuracy of any device is dependent on how well it is installed and how well it is configured. Because of this it is very important to work with Irisys to ensure that your test Vector is correctly setup as we recommend. Especially note the specific requirements when testing different countering technologies at the same location.

Please do not adopt the mindset that you will be ok doing your own testing and you don't need support from Irisys.

Also do not think that Irisys will interfere or manipulate your test data in any way. We just want our devices to be given the right installation and configuration parameters in order to ensure they will perform as well as they can do.

 

Comparison Testing Notes 

When comparing accuracy of different devices from different manufacturers, always follow the manufacturers recommended installation and configuration practices.

In most cases, the accuracy of counting through a doorway orn entrance will be the main requirement, and the recommendation for every device you are testing will most likely be to install centrally to the door that you want to count through. Although some will prefer to be closer or further away from the door, it is likely that the optimum installation position for two or more devices is the same spot on the ceiling, which is clearly not possible. In these cases you can do one of two things:

You can install one device at a time and simply evaluate each one in isolation with their own count data. Or you can install devices next to each other, either in a line back from the door, or side by side with some being off centre.

All should be installed within their allowable installation tolerances, but some devices will have larger field of views than others, and will easily operate at the same accuracy level when not installed in the perfect location.

It should be noted that some devices cannot be installed next to each other as the technology that they employ will affect each other often in some subtle or inperceivable way. See table below.

 Time Of Flight3D/Stereoscopic cameraRadarLiDar ("Laser Curtain")Infrared 'Beambreak'
Time Of FlightInterferenceOKOKPossible InterferenceOK
3D/Stereoscopic cameraOKOKOKOKOK
RadarOKOKInterferenceOKOK
Laser CurtainPossible InterferenceOKOKPossible interferenceOK
Infrared 'Beambreak'OKOKOKOK

OK

Remember that Vectors are Time of Flight based devices, so should not be tested alongside other active time of flight devices, including other Vectors!

Note that when Vectors are mounted next to each other as part of a Wide Tracker network, each one automatically selects a slightly different time of flight IR frequency to its neighbors, so that there is no interference.

When comparing devices for accuracy, always ensure they are running the latest firmware version from the manufacturer, in order to benefit from any counting improvements that may have been added later. 

Once installed, again you should follow the manufacturers configuration advice to ensure that the devices best accuracy can be achieved.

When comparing devices for accuracy you should evaluate a person by person count. Be wary of devices with an 'average accuracy' value, these have an accuracy based on the missed counts and over counts balancing each other out. A proper accuracy considers each person who is missed or over counted as an error.

Most counting devices will have some way to validate their accuracy, but when comparing devices you must make sure that the timescale involved in the validation is the same. I.e. the start and end of the accuracy testing should be synchronized between units so as to ensure each device is validated against the same people - effectively the same data set.

Irisys devices have a built in validation function where recordings can be made and then played back/watched to see how they performed. 
It should be noted that Irisys would expect a very high degree of accuracy and where accuracy is very low it is always down to an installation or configuration issue. Therefore please reach out to Irisys if you are seeing low accuracy for help and guidance.