Open Access Open Access  Restricted Access Subscription Access

A Two-Stage Plate Detection and Specialised Optical Character Recognition Pipeline for License Plate Recognition, Validated on Nigerian Plates from Aerial Drone Imagery

Izabo Abigo

Abstract


Automatic number plate recognition systems are typically trained and validated on the specific national plate format they are deployed against, which leaves an open question of how well a model trained on an internationally diverse but country-agnostic dataset generalises to a plate format, and a viewing geometry, it has never seen. This study presents a two-stage license plate detection and recognition pipeline, a YOLOv8n object detector for plate localisation followed by a specialised optical character recognition model for text extraction, trained entirely on an international dataset containing no Nigerian plates, and evaluated specifically on Nigerian plates captured from an aerial drone platform. The plate detector achieved a mean average precision at 50 percent intersection-over-union (mAP50) of 0.969, a precision of 0.985, and a recall of 0.949 on a 2,048-image validation set. Three optical character recognition approaches were compared directly: a general-purpose OCR library, a custom-trained character detector, and a specialised plate-OCR model trained across more than sixty countries' plate formats, with the specialised model producing the most consistent results across all three. When applied to three aerial drone photographs of Nigerian vehicles taken on a university campus, containing five visible plates in total, the system correctly detected all five plates and read four of them with complete accuracy; the fifth was read with one character omitted, traced to edge-of-crop clipping rather than an optical character recognition failure. Detection confidence on the drone imagery, 33 to 65 percent, was markedly lower than on the ground-level validation set, consistent with the reduced apparent plate width that a near-vertical aerial viewing angle produces, a finding this study evaluates directly against comparable prior work on aerial and drone-based plate recognition. The result demonstrates that internationally diverse training data can support genuine zero-shot generalisation to an unseen national plate format and an unseen camera geometry simultaneously, without any Nigeria-specific fine-tuning, while also identifying the specific, correctable failure mode, bounding-box edge clipping, responsible for the one partial read observed.


Full Text:

PDF

References


Anagnostopoulos, C., Anagnostopoulos, I., Loumos, V., & Kayafas, E. (2008). A license plate recognition algorithm for intelligent transportation system applications. IEEE Transactions on Intelligent Transportation Systems, 7(3), 377-392.

barkataliarbab. (2023). License plate detection dataset, 10,125 images [Data set]. Kaggle. https://www.kaggle.com/datasets/barkataliarbab/license-plate-detection-dataset-10125-images

Donoser, M., Arth, C., & Bischof, H. (2007). Detecting, tracking and recognizing license plates. In Proceedings of the Asian Conference on Computer Vision (pp. 566-575).

Fakhrurroja, H., Pramesti, D., Hidayatullah, A. R., Fashihullisan, A. A., Bangkit, H., & Ismail, N. (2023). Automated license plate detection and recognition using YOLOv8 and OCR with Tello drone camera. In 2023 International Conference on Computer, Control, Informatics and Its Applications (IC3INA) (pp. 206-211). IEEE. https://doi.org/10.1109/IC3INA60834.2023.10285750

fast-plate-ocr. (2024). fast-plate-ocr: Fast and lightweight OCR for vehicle license plates [Computer software]. GitHub. https://github.com/ankandrew/fast-plate-ocr

Federal Road Safety Corps. (2023). Vehicle registration and plate number standards in Nigeria. FRSC Publications.

Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 580-587).

Gou, C., Wang, K., Yao, Y., & Li, Z. (2016). Vehicle license plate recognition based on extremal regions and restricted Boltzmann machines. IEEE Transactions on Intelligent Transportation Systems, 17(4), 1096-1107.

Hasan, M., Alom, M. S., & Ali, M. S. (2020). Deep learning based automatic license plate recognition system for aerial images. In Proceedings of the International Conference on Computer, Communication, Chemical, Material and Electronic Engineering (IC4ME2) (pp. 1-4).

Jocher, G., Chaurasia, A., & Qiu, J. (2023). Ultralytics YOLOv8 [Computer software]. Ultralytics Inc. https://github.com/ultralytics/ultralytics

Karahan, E., & Ates, H. F. (2022). Performance evaluation of OCR systems for license plate recognition. In Proceedings of the IEEE Signal Processing and Communications Applications Conference (pp. 1-4).

Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, 25, 1097-1105.


Refbacks

  • There are currently no refbacks.