ITEA 4 page header azure circular

Context-Aware Multimodal Video Anomaly Detection and Localization Framework

Project
22006 SINTRA
Type
Enhancement
Description

An exploitable AI framework for intelligent video surveillance that goes beyond binary anomaly detection by combining anomaly scoring with semantic interpretation, object-level segmentation/localization and depth-aware scene understanding. The result can enhance industrial video analytics by enabling security systems to detect suspicious events and provide contextual information about what happened, when it occurred and where the relevant objects/regions are located.

Contact
Aylin Yorulmaz
Email
aylin.yorulmaz@kocsistem.com.tr
Research area(s)
Computer Vision, Multimodal AI, Agentic AI, Video Anomaly Detection, NLP/NER, Deep Learning
Technical features

Multi-stage anomaly detection Open-vocabulary event interpretation Object detection and segmentation Spatial and depth-aware localization Critical-frame selection Contextual anomaly description Human-in-the-loop decision support Requires integration with existing CCTV/VMS streams Performance depends on camera quality, viewpoint and operating environment Real-time deployment requires validation of GPU/edge latency and memory Deployment-specific threshold calibration and false-alarm validation are required

Integration constraints

Security and surveillance solution providers Smart-city operators Airports and transportation hubs Industrial facilities Critical infrastructure operators System integrators and enterprise security teams

Targeted customer(s)

Security and surveillance solution providers, system integrators, smart-city operators, airports and transportation hubs, industrial facilities, and critical-infrastructure operators seeking enhanced AI-based video analytics. The primary markets are intelligent video surveillance, physical security, smart infrastructure, transportation security, and industrial safety. Potential business partners include VMS/CCTV providers and AI/edge-computing integrators with expertise in video management systems, camera integration, edge/GPU deployment, and operational security workflows.

Conditions for reuse

Reusable as an R&D software framework, demonstrator or integration module subject to model/dataset licensing and IP conditions, customer-specific fine-tuning and scenario validation required before operational deployment, not yet positioned as a standalone commercial product.

Confidentiality
Public
Publication date
09-11-2026
Involved partners
TAV Technologies (TUR)
KoçSistem (TUR)