Oosto’s Chief Technology Officer and Chief AI Scientist presented a bold new vision for video analytics leveraging contextual scene understanding and semantic segmentation at this week’s ISC East, the International Security Conference & Exposition, in New York.

In their presentation, Oosto laid out how the use of these new technologies can deliver real-time contextual analytics and more accurate alerts based on a more holistic understanding of a scene.

Providing limited insights

Historically, the AI in video analytics is usually single-threaded and purpose-built to perform a specific function like facial recognition, object detection, or licence plate recognition. This limits an organisation’s ability to have a more complete understanding of a scene from video surveillance. This also means that the metadata is limited to the single use case, disconnected from the other algorithms, and unable to holistically make sense of a scene.

Today’s video analytics provide limited insights which can translate to poor and missed alarms"

Video analytics is still in its infancy. Today’s video analytics provide limited insights which can translate to poor and missed alarms,” said Dieter Joecker, Oosto's Chief Technology Officer, adding “Wandering through ISC East and talking to enterprise customers and the partners who serve them, it's clear that the world of physical security needs to move out of the dark ages and help organisations prevent incidents of violence and vandalism, or to minimise the damage immediately after.”

Live video surveillance

Dieter Joecker said, “Tomorrow, commercial enterprises will harness the power of contextual scene analysis – multithreaded AI – to deliver real-time contextual analytics and precision alerts based on a more holistic understanding of live video surveillance.”

He adds, “For example, when someone falls down in a store, this could mean any number of things: Were they actually bending over to tie their shoes? Were they pushed by another person? Was it a staged ‘slip & fall’ to generate a fraudulent claim? Is the person having a legitimate medical emergency? How an organisation responds in real-time is based on the timeliness and quality of the alert.”

Semantic scene understanding

We can also start to capture more metadata to gain greater context about what’s occurring in real-time"

Leading Vision AI companies are starting to exploit the power of semantic segmentation and edge computing to deliver real-time contextual analytics and alerts to achieve a more holistic understanding of video footage,” said Professor Marios Savvides, Director of Carnegie Mellon University’s CyLab Biometrics Center and Oosto Chief AI Scientist.

He adds, “We can also start to capture more metadata to gain greater context about what’s occurring in real-time and ensure that the right types of alerts are sent to the right personnel. Instead of relying on surveillance professionals to monitor video footage 24x7, security teams can use their skills to respond to very precise alerts. It’s not just about adding more algorithms. Leading companies are going to use the power of semantic scene understanding and edge computing to deliver real-time contextual analytics and alerts based on a more granular and complete understanding of a scene.”

First responder practitioners

The International Security Conference & Exposition, also known as ISC East, is the Northeast’s leading security & public safety event, hosted in collaboration with the premier sponsor Security Industry Association (SIA). The show brings together security dealers, installers, integrators, and consultants, along with corporate, government, and law enforcement/first responder practitioners, to share best practices and technologies designed to keep the communities safe and secure.

At the conference, Oosto presented its access control and watchlist alerting solutions based on facial recognition, which are used today by government organisations, airports, casinos, hospitals, and many other entities to improve security and safety in physical spaces. In addition, Oosto’s leadership was invited to speak at the conference and present the future concept of AI-based video analysis.

Stay ahead in the era of intelligent security systems powered by Artificial Intelligence with our special e-magazine on AI in security.

In case you missed it

How can physical security systems make schools safer?
How can physical security systems make schools safer?

Students deserve a safe and positive environment where they can learn and thrive. Teachers and administrators should be able to focus on their primary role of educating students be...

DNAKE smart intercom elevates Dickensa 27 security
DNAKE smart intercom elevates Dickensa 27 security

Dickensa 27, a modern residential complex in Warsaw, Poland, sought to enhance its security, communication, and convenience for residents through advanced intercom solutions. ...

Anviz transforms traditional property management into a smart reality, making digitisation more than just talk
Anviz transforms traditional property management into a smart reality, making digitisation more than just talk

The Middle East has recently expanded its real estate market as the region's economy grows and urbanisation accelerates. This trend has led to an increasing demand for smart securi...

Quick poll
How likely is it that companies will invest in cloud-based physical security solutions in the next 5 years?