Conference paper · 1st International Edessa Scientific Studies Congress · 2026
Multi-Modal Sensing for Real-Time Operations Monitoring in Physical Retail: A Framework Combining Computer Vision, IoT Telemetry, and Transactional Signals
Kemal Büyüktaş (printed as “Kemal BUYUKTAS”) · Flo Technology, Technology Department, Istanbul, Türkiye · ORCID 0009-0007-7884-2872
Abstract
Physical retail stores continue to generate a substantial share of total revenue in many categories, but the operational visibility available to store managers still lags far behind what digital channels provide. Workforce activity, opening and closing routines, customer density, checkout flow, fitting-room dynamics, and after-hours store activity are typically inferred from manual observation or sales proxies rather than measured continuously. As a consequence, structural inefficiencies often remain invisible until they show up as lost sales or compliance incidents. This study reports on a multi-modal sensing framework that narrows this gap by repurposing in-store infrastructure already in place for unrelated reasons: security cameras, point-of-sale terminals, door and turnstile counters, energy and lighting sensors, fitting-room occupancy signals, and the corporate time-attendance system. Signals from these sources feed a shared operational layer connected to a real-time alerting and feedback mechanism. The framework was deployed in twelve pilot stores of a large omnichannel apparel and footwear retailer over a six-month window, under a privacy-preserving, edge-inference architecture. A directional, observational analysis indicates that idle staff time during peak hours fell by around 20%, coverage of previously underserved zones grew by close to 30%, unrecorded early closures dropped sharply (about 81%), average checkout wait times shortened by roughly a quarter, fitting-room abandonment decreased by approximately 20%, and staff time-attendance discrepancies fell by close to 60%. Two stores diverged from this pattern, illustrating that camera placement and sensor coverage materially affect what such a framework can deliver.
Keywords: Multi-Modal Sensing, Retail Operations, Computer Vision
Results reported in the paper
- Idle staff time, peak hours28.4% of staff-hours → 22.6%−20.4%
- Coverage of underserved store zones41.0% of expected → 53.2%+29.8%
- Unrecorded early closures3.7 per store per month → 0.7−81.1%
- Average checkout wait, peak hours138 s → 104 s−24.6%
- Fitting-room abandonment16.3% → 13.1%−19.6%
- After-hours unauthorised activity capturednot observable → 14 eventsnewly visible
- Energy use while unstaffed (index)100.0 → 84.7−15.3%
- Time-attendance discrepancies9.1% of shifts → 3.6%−60.4%
- Conversion in high-density zones, peak hours18.2% → 19.7%+8.2%
| Metric | Before | After | Change |
|---|---|---|---|
| Idle staff time, peak hours | 28.4% of staff-hours | 22.6% | −20.4% |
| Coverage of underserved store zones | 41.0% of expected | 53.2% | +29.8% |
| Unrecorded early closures | 3.7 per store per month | 0.7 | −81.1% |
| Average checkout wait, peak hours | 138 s | 104 s | −24.6% |
| Fitting-room abandonment | 16.3% | 13.1% | −19.6% |
| After-hours unauthorised activity captured | not observable | 14 events | newly visible |
| Energy use while unstaffed (index) | 100.0 | 84.7 | −15.3% |
| Time-attendance discrepancies | 9.1% of shifts | 3.6% | −60.4% |
| Conversion in high-density zones, peak hours | 18.2% | 19.7% | +8.2% |
Twelve pilot stores over six months, as published in the paper (Table 1). The paper presents these as directional, observational figures rather than causal estimates. Two stores diverged because of camera placement and a mid-pilot POS upgrade.
Cite this paper
APA 7Buyuktas, K. (2026). Multi-modal sensing for real-time operations monitoring in physical retail: A framework combining computer vision, IoT telemetry, and transactional signals. In S. Yıldız & M. F. Işık (Eds.), 1st International Edessa Scientific Studies Congress: Congress book (pp. 365–374). ISARC.
BibTeX
@inproceedings{buyuktas2026multimodal,
author = {Buyuktas, Kemal},
title = {Multi-Modal Sensing for Real-Time Operations Monitoring in Physical Retail: A Framework Combining Computer Vision, IoT Telemetry, and Transactional Signals},
booktitle = {1st International Edessa Scientific Studies Congress: Congress Book},
editor = {Yıldız, Sevcan and Işık, Mehmet Fatih},
pages = {365--374},
year = {2026},
address = {Şanlıurfa, Türkiye},
publisher = {ISARC},
isbn = {978-625-378-664-9},
url = {https://kemalbuyuktas.com/papers/multi-modal-sensing-retail}
}Other papers
- From Transactional Loyalty to Behavioral Engagement: A Data-Driven Framework for Customer Value Creation in Omnichannel Retail10th International Mediterranean Scientific Research and Innovation Congress · 2026
- A Multi-Model Artificial Intelligence System for Content Generation and Data Analysis in E-Commerce Operations12th International Hasankeyf Scientific Research and Innovation Congress · 2026
- Supply Chain Automation: Optimization of Warehouse and Carrier Assignment System8th International Selçuk Scientific Research Congress · 2025