Vehicle Detection and Classification for Toll collection using YOLOv11 and Ensemble OCR
This provides a scalable solution for toll operators to reduce hardware costs and improve efficiency, though it is incremental as it builds on existing computer vision methods.
The paper tackled automated toll collection by developing a system using YOLOv11 and ensemble OCR with a single camera, achieving a mAP of 0.895, 98.5% license plate recognition accuracy, 94.2% axle detection accuracy, and 99.7% OCR confidence.
Traditional automated toll collection systems depend on complex hardware configurations, that require huge investments in installation and maintenance. This research paper presents an innovative approach to revolutionize automated toll collection by using a single camera per plaza with the YOLOv11 computer vision architecture combined with an ensemble OCR technique. Our system has achieved a Mean Average Precision (mAP) of 0.895 over a wide range of conditions, demonstrating 98.5% accuracy in license plate recognition, 94.2% accuracy in axle detection, and 99.7% OCR confidence scoring. The architecture incorporates intelligent vehicle tracking across IOU regions, automatic axle counting by way of spatial wheel detection patterns, and real-time monitoring through an extended dashboard interface. Extensive training using 2,500 images under various environmental conditions, our solution shows improved performance while drastically reducing hardware resources compared to conventional systems. This research contributes toward intelligent transportation systems by introducing a scalable, precision-centric solution that improves operational efficiency and user experience in modern toll collections.