Simple Vision System for Apple Varieties Classification
Abstract
Abstract
Every variety of apple has its particular physical characteristics, which are affected by different pre-harvest factors. Manual classification of these varieties by human labor has several weaknesses, such as the inconsistency, subjectivity, fatigue and different accuracy due to different level of experience of the inspector. This study was aimed to design and evaluate a simple computer-based vision system for recognizing and grading several varieties of apples based on their physical characteristics. Images of apples were taken and were used as training data with different algorithms to extract the particular characteristics of each variety, such as color and shape. The extracted Hue color channels and contour vector were recorded as the reference data and were used to recognize the similar characteristic of those images from the testing data group. The k-nearest neighbors algorithm was used to decide whether an apple belongs to a particular variety. The results show that the recognition rate based on color only was between 84–97% and it was between 5–77% it is based on the shape only. Rotating the image significantly increases the recognition rate (to be between 5 - 69% based on the shape only). Moreover, combining both color and shape characteristics significantly improves the recognition rate.
Keywords: apple’s varieties classification, color signatures, combined color-morphology signatures, morphology signature, vision system
Abstrak
Setiap jenis buah apel memiliki penciri fisik spesifik, yang dipengaruhi oleh berbagai faktor pra-panen. Teknik klasifikasi manual memiliki banyak kelemahan, antara lain adalah subjektifitas, ketidakkonsistenan, kelelahan fisik dan psikologis, serta tingkat pengalaman dari petugas yang melakukannya. Tujuan studi ini adalah melakukan proses desain dan pengujian suatu sistem visi sederhana berbasis komputer untuk mengenali dan mengklasifikasi berbagai jenis buah apel berdasarkan penciri spesifiknya. Citra buah apel dari sampel latih diproses dengan berbagai algoritma untuk mengekstraksi berbagai parameter pencirinya, yaitu parameter warna dan bentuk. Informasi histogram kanal warna Hue dan vektor kontur hasil ekstraksi kemudian disimpan sebagai data referensi dan digunakan sebagai pembanding terhadap parameter serupa dari citra data uji. Keputusan diambil menggunakan algoritma K-Nearest Neighbors. Hasil menunjukkan bahwa laju pengenalan berbasis fitur tunggal warna berkisar antara 84–97%, sementara berbasis fitur tunggal morfologi berkisar antara 5–77%. Perubahan orientasi sampel sebagai data training akan meningkatkan laju pengenalan berbasis fitur tunggal morfologi secara signifikan, yaitu dari 5% menjadi 69%. Penggabungan dua fitur penciri warna dan morfologi dapat meningkatkan laju pengenalan lebih baik lagi.
Kata Kunci: klasifikasi jenis buah apel, penciri warna, penciri morfologi, gabungan penciri warna dan morfologi, sistem visi
Keywords
Full Text:
PDFReferences
Ajmal, A., Hollitt, C., Frean, M., & Al-Sahaf, H. (2018). A comparison of RGB and HSV colour spaces for visual attention models. 2018 International Conference on Image and Vision Computing New Zealand (IVCNZ), 2018-Novem, 1–6. IEEE. https://doi.org/10.1109/IVCNZ.2018.8634752
Arshad, M., Shahnawaz, M., Shahkeela, S., Hussain, M., Ahmad, M., & Khan, S. S. (2014). Significance of physical properties of apple fruit influenced by preharvest orchard management factors. European Journal of Experimental Biology, 4(5), 82–89.
Bedeli, M., Geradts, Z., & van Eijk, E. (2018). Clothing identification via deep learning: forensic applications. Forensic Sciences Research, 3(3), 219–229. https://doi.org/10.1080/20961790.2018.1526251
Behera, S. K., Rath, A. K., Mahapatra, A., & Sethy, P. K. (2020). Identification, classification & grading of fruits using machine learning & computer intelligence: a review. Journal of Ambient Intelligence and Humanized Computing, (March). https://doi.org/10.1007/s12652-020-01865-8
Bhargava, A., & Bansal, A. (2021). Fruits and vegetables quality evaluation using computer vision: A review. Journal of King Saud University - Computer and Information Sciences, 33(3), 243–257. https://doi.org/10.1016/j.jksuci.2018.06.002
Bhargava, A., Bansal, A., & Goyal, V. (2022). Machine learning–based detection and sorting of multiple vegetables and fruits. Food Analytical Methods, 15(1), 228–242. https://doi.org/10.1007/s12161-021-02086-1
Bradski, G., & Kaehler, A. (2008). Learning OpenCV. Sebastopol: O’Reilly Media.
Brosnan, T., & Sun, D.-W. (2004). Improving quality inspection of food products by computer vision-a review. Journal of Food Engineering, 61(1), 3–16. https://doi.org/10.1016/S0260-8774(03)00183-3
Chaudhary, L., & Yogesh, Y. (2019). A comparative study of fruit defect segmentation techniques. 2019 International Conference on Issues and Challenges in Intelligent Computing Techniques (ICICT), 1–4. Ghaziabad, India: IEEE. https://doi.org/10.1109/ICICT46931.2019.8977692
Goñi, S. M., & Salvadori, V. O. (2017). Color measurement: comparison of colorimeter vs. computer vision system. Journal of Food Measurement and Characterization, 11(2), 538–547. https://doi.org/10.1007/s11694-016-9421-1
He, Y., Xiao, Q., Bai, X., Zhou, L., Liu, F., & Zhang, C. (2021). Recent progress of nondestructive techniques for fruits damage inspection: a review. Critical Reviews in Food Science and Nutrition, 0(0), 1–19. https://doi.org/10.1080/10408398.2021.1885342
Hu, M.-K. (1962). Visual pattern recognition by moment invariants. IEEE Transactions on Information Theory, 8(2), 179–187. https://doi.org/10.1109/TIT.1962.1057692
Khanam, Al-Naji, & Chahl. (2019). Remote monitoring of vital signs in diverse non-clinical and clinical scenarios using computer vision systems: A review. Applied Sciences, 9(20), 4474. https://doi.org/10.3390/app9204474
Laabassi, K., Belarbi, M. A., Mahmoudi, S., Mahmoudi, S. A., & Ferhat, K. (2021). Wheat varieties identification based on a deep learning approach. Journal of the Saudi Society of Agricultural Sciences, 20(5), 281–289. https://doi.org/10.1016/j.jssas.2021.02.008
Larose, D. T., & Larose, C. D. (2014). Discovering Knowledge in Data: An Introduction to Data Mining. Hoboken, N.J., USA: John Wiley & Sons, Inc.
Li, Y., Feng, X., Liu, Y., & Han, X. (2021). Apple quality identification and classification by image processing based on convolutional neural networks. Scientific Reports, 11(1), 16618. https://doi.org/10.1038/s41598-021-96103-2
Liu, L., Li, Z., Lan, Y., Shi, Y., & Cui, Y. (2019a). Design of a tomato classifier based on machine vision. PLOS ONE, 14(7), e0219803. https://doi.org/10.1371/journal.pone.0219803
Liu, Z., Zhang, Z., Liu, Y., Dezert, J., & Pan, Q. (2019b). A new pattern classification improvement method with local quality matrix based on K-NN. Knowledge-Based Systems, 164, 336–347. https://doi.org/10.1016/j.knosys.2018.11.001
Lutu, P. E. N., & Engelbrecht, A. P. (2006). A comparative study of sample selection methods for classification. South African Computer Journal, 6(36), 69–85. https://doi.org/10.46298/arima.1880
Mathiassen, J. R., Misimi, E., Østvik, S. O., & Aursand, I. G. (2012). Computer vision in the fish industry. In D.-W. (University C. D. Sun (Ed.), Computer Vision Technology in the Food and Beverage Industries (pp. 352–378). Cambridge: Elsevier. https://doi.org/10.1533/9780857095770.3.352
Mikolajczyk, A., & Grochowski, M. (2018). Data augmentation for improving deep learning in image classification problem. 2018 International Interdisciplinary PhD Workshop (IIPhDW), 117–122. IEEE. https://doi.org/10.1109/IIPHDW.2018.8388338
Mutneja, D. V. (2015). Methods of image edge detection: A review. Journal of Electrical & Electronic Systems, 4(2), 1000150. https://doi.org/10.4172/2332-0796.1000150
Nanni, L., Paci, M., Brahnam, S., & Lumini, A. (2021). Comparison of different image data augmentation approaches. Journal of Imaging, 7(12), 254. https://doi.org/10.3390/jimaging7120254
Nashat, S., & Abdullah, M. Z. (2016). Quality Evaluation of Bakery Products. In Computer Vision Technology for Food Quality Evaluation (pp. 525–589). Elsevier. https://doi.org/10.1016/B978-0-12-802232-0.00021-9
Nixon, M. S., & Aguado, A. S. (2012). Feature Extraction & Image Processing for Computer Vision. In Feature Extraction and Image Processing for Computer Vision (4th Editio). London: Elsevier. https://doi.org/10.1016/C2011-0-06935-1
Ouchtati, S., Chergui, A., Mavromatis, S., Aissa, B., Rafik, D., & Sequeira, J. (2019). Novel method for brain tumor classification based on use of image entropy and seven hu’s invariant moments. Traitement Du Signal, 36(6), 483–491. https://doi.org/10.18280/ts.360602
Sekehravani, E. A., Babulak, E., & Masoodi, M. (2020). Implementing canny edge detection algorithm for noisy image. Bulletin of Electrical Engineering and Informatics, 9(4), 1404–1410. https://doi.org/10.11591/eei.v9i4.1837
Solomon, C., & Breckon, T. (2011). Fundamentals of Digital Image Processing: A Practical Approach with Examples in MATLAB. Chichester: John Wiley & Sons.
Song, J., Gao, S., Zhu, Y., & Ma, C. (2019). A survey of remote sensing image classification based on CNNs. Big Earth Data, 3(3), 232–254. https://doi.org/10.1080/20964471.2019.1657720
Taheri-Garavand, A., Fatahi, S., Omid, M., & Makino, Y. (2019). Meat quality evaluation based on computer vision technique: A review. Meat Science, 156(June), 183–195. https://doi.org/10.1016/j.meatsci.2019.06.002
Teixeira, G. H. de A., Meakem, V., Morais, C. de L. M. de, Lima, K. M. G. de, & Whitehead, S. R. (2020). Conventional and alternative pre-harvest treatments affect the quality of ‘Golden delicious’ and ‘York’ apple fruit. Environmental and Experimental Botany, 173(February), 104005. https://doi.org/10.1016/j.envexpbot.2020.104005
Tian, H., Wang, T., Liu, Y., Qiao, X., & Li, Y. (2020). Computer vision technology in agricultural automation —A review. Information Processing in Agriculture, 7(1), 1–19. https://doi.org/10.1016/j.inpa.2019.09.006
Tripathi, M. K., & Maktedar, D. D. (2020). A role of computer vision in fruits and vegetables among various horticulture products of agriculture fields: A survey. Information Processing in Agriculture, 7(2), 183–203. https://doi.org/10.1016/j.inpa.2019.07.003
Uji, T. (2007). Review: Species diversity of indigenous fruits in Indonesia and its potential. Biodiversitas Journal of Biological Diversity, 8(2), 157–167. https://doi.org/10.13057/biodiv/d080217
Witus, I. K., On, C. K., Alfred, R., Ibrahim, A. A. A., Guan, T. T., & Anthony, P. (2018). A review of computer vision methods for fruit recognition. Advanced Science Letters, 24(2), 1538–1542. https://doi.org/10.1166/asl.2018.10786
Xu, Y., & Goodacre, R. (2018). On splitting training and validation set: A comparative study of cross-validation, bootstrap and systematic sampling for estimating the generalization performance of supervised learning. Journal of Analysis and Testing, 2(3), 249–262. https://doi.org/10.1007/s41664-018-0068-2
https://doi.org/10.21776/ub.industria.2022.011.01.6
Refbacks
- There are currently no refbacks.