Development of an online Nigella sativa inspection system equipped with machine vision technology and artificial neural networks
Abstract
Aim of study: Nigella sativa L. seeds usually are mixed with impurities, which affect its quality and influences consumer acceptance in both raw seeds and the oil market. In this study, an intelligent system based on the combination of machine vision (MV) and artificial neural networks (ANN) was developed to classify and clean N. sativa seeds and its impurities.
Area of study: Iran, Kurdistan province.
Material and methods: For accurate detections we developed a robust image processing algorithm including image acquisition, image enhancement, segmentation, and feature extraction steps. Correlation-based Feature Selection method was used to select the superior features. Three methods of linear discriminant analysis, support vector machines, and ANN were used to classify the data.
Main results: The statistical indices of sensitivity, specificity, and accuracy for N. sativa in the online phase were 90%, 98.93%, and 97.04%, respectively. The average of these measurements for the impurities class was 95.57%, 96.89%, and 96.58%, respectively.
Research highlights: The results demonstrated the feasibility of suggested machine learning and image processing approaches in the real-time cleaning of N. sativa. The image acquisition and processing process, including selection of the best lighting methods to reduce the shadows, noise elimination and segmentation, provided precise results. The final results indicated the effectiveness of proposed machine learning algorithm in feature extraction, feature dimensionality reduction, and classification approaches. This methodology can be recommended for detection, classification and automatic cleaning of other similar seeds.
Downloads
References
Bao Y, Mi C, Wu N, Liu F, He Y, 2019. Rapid classification of wheat grain varieties using hyperspectral imaging and chemometrics. Appl Sci 9(19): 4119. https://doi.org/10.3390/app9194119
Banakar A, Zareiforoush H, Baigvand M, Montazeri M, Khodaei J, Behroozi‐Khazaei N, 2017. Combined application of decision tree and fuzzy logic techniques for intelligent grading of dried figs. J Food Process Eng 40(3): e12456. https://doi.org/10.1111/jfpe.12456
Copeland LO, McDonald MF, 2012. Principles of seed science and technology. Springer Sci & Bus Media.
Ebrahimi E, Mollazade K, Babaei S, 2014. Toward an automatic wheat purity measuring device: A machine vision-based neural networks-assisted imperialist competitive algorithm approach. Measurement 55: 196-205. https://doi.org/10.1016/j.measurement.2014.05.003
Fayyazi S, Abbaspour-Fard MH, Rohani A, Monadjemi SA, Sadrnia H, 2017. Identification and classification of three Iranian rice varieties in mixed bulks using image processing and MLP neural network. Int J Food Eng 13(5): 20160121. https://doi.org/10.1515/ijfe-2016-0121
Gharby S, Harhar H, Guillaume D, Roudani A, Boulbaroud S, Ibrahimi M, et al., 2015. Chemical investigation of Nigella sativa L. seed oil produced in Morocco. J Saudi Soc Agric Sci 14(2): 172-177. https://doi.org/10.1016/j.jssas.2013.12.001
Granitto PM, Verdes PF, Ceccatto HA, 2005. Large-scale investigation of weed seed identification by machine vision. Comput Electron Agric 47(1): 15-24. https://doi.org/10.1016/j.compag.2004.10.003
Han XZ, Wang KJ, Yuan Y, Chen C, Liang L, 2014. Research on grading detection of the wheat seeds. Sci World J 2014: 702906. https://doi.org/10.1155/2014/702906
Jolliffe IT, Cadima J, 2016. Principal component analysis: a review and recent developments. Philos T Roy Soc A 374(2065): 20150202. https://doi.org/10.1098/rsta.2015.0202
Kanjanawanishkul K, Chupawa P, Nuantoon T, 2018. Design and assessment of an automated sweet pepper seed sorting machine. Eng Agr Environ Food 11(4): 196-201. https://doi.org/10.1016/j.eaef.2018.05.001
Liu D, Ning X, Li Z, Yang D, Li H, Gao L, 2015. Discriminating and elimination of damaged soybean seeds based on image characteristics. Stored Prod Res 60: 67-74. https://doi.org/10.1016/j.jspr.2014.10.001
Madhavan J, Salim M, Durairaj U, Kotteeswaran R, 2020. Wheat seed classification using neural network pattern recognizer. Mater Today Proc. https://doi.org/10.1016/j.matpr.2021.03.226
Majdalawieh AF, Fayyad MW, 2016. Recent advances on the anti-cancer properties of Nigella sativa, a widely used food additive. J Ayurveda Integr Med 7(3): 173-180. https://doi.org/10.1016/j.jaim.2016.07.004
Mollazade K, Omid M, Arefi A, 2012a. Comparing data mining classifiers for grading raisins based on visual features. Comput Electron Agric 84: 124-131. https://doi.org/10.1016/j.compag.2012.03.004
Mollazade K, Omid M, Tab FA, Mohtasebi SS, 2012b. Principles and applications of light backscattering imaging in quality evaluation of agro-food products: a review. Food Bioprocess Technol 5(5): 1465-1485. https://doi.org/10.1007/s11947-012-0821-x
Mollazade K, 2017. Non-destructive identifying level of browning development in button mushroom (Agaricus bisporus) using hyperspectral imaging associated with chemometrics. Food Anal Meth 10(8): 2743-2754. https://doi.org/10.1007/s12161-017-0845-y
Nouri-Ahmadabadi H, Omid M, Mohtasebi SS, Firouz MS, 2017. Design, development and evaluation of an online grading system for peeled pistachios equipped with machine vision technology and support vector machine. Inf Process Agric 4(4): 333-341. https://doi.org/10.1016/j.inpa.2017.06.002
Orlandi G, Calvini R, Foca G, Ulrici A, 2018. Automated quantification of defective maize kernels by means of multivariate image analysis. Food Control 85: 259-268. https://doi.org/10.1016/j.foodcont.2017.10.008
Pearson T, Moore D, Pearson J, 2012. A machine vision system for high speed sorting of small spots on grains. Food Measure 6(1): 27-34. https://doi.org/10.1007/s11694-012-9130-3
Qadri S, Furqan Qadri S, Razzaq A, Ul Rehman M, Ahmad N, Nawaz SA, et al., 2021. Classification of canola seed varieties based on multi-feature analysis using computer vision approach. Int J Food Prop 24(1): 493-504. https://doi.org/10.1080/10942912.2021.1900235
Quan L, Zhang T, Sun L, Chen X, Xu Z, 2018. Design and testing of an on-line omnidirectional inspection and sorting system for soybean seeds. Appl Eng Agric 34(6): 1003-1016. https://doi.org/10.13031/aea.12935
Rad SJ, Tab FA, Mollazade K, 2011. Classification of rice varieties using optimal color and texture features and BP neural networks. 7th Iran Conf on Machine Vision and Image Processing, Nov 16, pp. 1-5. IEEE. https://doi.org/10.1109/IranianMVIP.2011.6121583
Rahman A, Cho BK, 2016. Assessment of seed quality using non-destructive measurement techniques: A review. Seed Sci Res 26(4): 285-305. https://doi.org/10.1017/S0960258516000234
Shen W, Cheng F, Zhang Y, Wei X, Fu Q, Zhang Y, 2020. Automatic recognition of ingestive-related behaviors of dairy cows based on triaxial acceleration. Inf Process Agric 7(3): 427-443. https://doi.org/10.1016/j.inpa.2019.10.004
Shrestha BL, Kang YM, Yu D, Baik OD, 2016. A two-camera machine vision approach to separating and identifying laboratory sprouted wheat kernels. Biosyst Eng 147: 265-273. https://doi.org/10.1016/j.biosystemseng.2016.04.008
Stanimirova I, Daszykowski M, Walczak B, 2013. Robust methods in analysis of multivariate food chemistry data. Data Handling Sci Technol 1(28): 315-340. https://doi.org/10.1016/B978-0-444-59528-7.00008-9
Teimouri N, Omid M, Mollazade K, Rajabipour A, 2014. A novel artificial neural networks assisted segmentation algorithm for discriminating almond nut and shell from background and shadow. Comput Electron Agric 105: 34-43. https://doi.org/10.1016/j.compag.2014.04.008
Teimouri N, Omid M, Mollazade K, Mousazadeh H, Alimardani R, Karstoft H, 2018. On-line separation and sorting of chicken portions using a robust vision-based intelligent modelling approach. Biosyst Eng 167: 8-20. https://doi.org/10.1016/j.biosystemseng.2017.12.009
Valiente-Gonzalez JM, Andreu-Garcia G, Potter P, Rodas-Jorda A, 2014. Automatic corn (Zea mays) kernel inspection system using novelty detection based on principal component analysis. Biosyst Eng 117: 94-103. https://doi.org/10.1016/j.biosystemseng.2013.09.003
Vithu P, Moses JA, 2016. Machine vision system for food grain quality evaluation: A review. Trends Food Sci Technol 1(56): 13-20. https://doi.org/10.1016/j.tifs.2016.07.011
Wakholi C, Kandpal LM, Lee H, Bae H, Park E, Kim MS, et al., 2018. Rapid assessment of corn seed viability using short wave infrared line-scan hyperspectral imaging and chemometrics. Sens Actuators B Chem 255: 498-507. https://doi.org/10.1016/j.snb.2017.08.036
Copyright (c) 2023 INIA-CSIC
This work is licensed under a Creative Commons Attribution 4.0 International License.
© CSIC. Manuscripts published in both the print and online versions of this journal are the property of the Consejo Superior de Investigaciones Científicas, and quoting this source is a requirement for any partial or full reproduction.
All contents of this electronic edition, except where otherwise noted, are distributed under a Creative Commons Attribution 4.0 International (CC BY 4.0) licence. You may read the basic information and the legal text of the licence. The indication of the CC BY 4.0 licence must be expressly stated in this way when necessary.
Self-archiving in repositories, personal webpages or similar, of any version other than the final version of the work produced by the publisher, is not allowed.
