<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="nlm-ta">Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria (INIA)</journal-id>
      <journal-id journal-id-type="publisher-id">e1001</journal-id>
      <journal-title>Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria (INIA)</journal-title><issn pub-type="ppub"> 2171-9292</issn><issn pub-type="epub"> 2171-9292</issn><publisher>
      	<publisher-name>Instituto Nacional de Investigación y Tecnología Agraria y Alimentaria (INIA)</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">https://doi.org/10.5424/sjar/2021191-15656</article-id>
      <article-categories>
        <subj-group subj-group-type="heading">
          <subject>Research Article</subject>
        </subj-group>
        <subj-group><subject>prediction of disorders</subject><subject>calcium disorders</subject><subject>multiclass classification</subject><subject>binary-class classification</subject></subj-group>
      </article-categories>
      <title-group>
        <article-title>Potential of VIS/NIR spectroscopy to detect and predict bitter pit in ‘Golden Smoothee’ apples</article-title><subtitle>Potential of VIS/NIR spectroscopy to detect and predict bitter pit in ‘Golden Smoothee’ apples</subtitle></title-group>
      <contrib-group><contrib contrib-type="author">
	<name name-style="western">
	<surname>Torres</surname>
		<given-names>Estanis</given-names>
	</name>
	<aff>IRTA Fruitcentre, Agri-food Science and Technology Park, Gardeny Park, Fruitcentre Building, 25003 Lleida, Spain.</aff>
	</contrib><contrib contrib-type="author">
	<name name-style="western">
	<surname>Recasens</surname>
		<given-names>Inmaculada</given-names>
	</name>
	<aff>University of Lleida, Dept. Horticulture, Botany and Gardening. Av. Rovira Roure 191, 25198 Lleida, Spain.</aff>
	</contrib><contrib contrib-type="author">
	<name name-style="western">
	<surname>Alegre</surname>
		<given-names>Simó</given-names>
	</name>
	<aff>IRTA Fruitcentre, Agri-food Science and Technology Park, Gardeny Park, Fruitcentre Building, 25003 Lleida, Spain.</aff>
	</contrib></contrib-group>		
      <pub-date pub-type="ppub">
        <month>03</month>
        <year>2021</year>
      </pub-date>
      <pub-date pub-type="epub">
        <day>29</day>
        <month>03</month>
        <year>2021</year>
      </pub-date>
      <volume>19</volume>
      <issue>1</issue>
      <permissions>
        <copyright-statement>© 2021 Copyright © 2020 INIA.  This  is an  open  access  article  distributed  under  the  terms  of the  Creative  Commons  Attribution  4.0 International (CC-by 4.0) License.</copyright-statement>
        <copyright-year>2021</copyright-year>
        <license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/2.5/"><p>This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</p></license>
      </permissions>
      <related-article related-article-type="companion" vol="2" page="e235" id="RA1" ext-link-type="pmc">
			<article-title>Potential of VIS/NIR spectroscopy to detect and predict bitter pit in ‘Golden Smoothee’ apples</article-title>
      </related-article>
	  <abstract abstract-type="toc">
		<p>
			Aim of study: A portable VIS/NIR spectrometer and chemometric techniques were combined to identify bitter pit (BP) in Golden apples.  Area of study: Worldwide  Material and methods: TThree different classification algorithms – linear discriminant analysis (LDA), quadratic discriminant analysis (QDA) and support-vector machine (SVM) –were used in two experiments. In experiment #1, VIS/NIR measurements were carried out at postharvest on apples previously classified according to 3 classes (class 1: non-BP; class 2: slight symptoms; class 3: severe symptoms). In experiment #2, VIS/NIR measurements were carried out on healthy apples collected before harvest to determinate the capacity of the classification algorithms for detecting BP prior to the appearance of symptoms.  Main results: In the experiement #1, VIS/NIR spectroscopy showed great potential in pitted apples detection with visibly symptoms (accuracies of 75–81%). The linear classifier LDA performed better than the multivariate non-linear QDA and SVM classifiers in discriminating between healthy and bitter pitted apples. In the experiment #2, the accuracy to predict bitter pit prior to the appearance of visible symptoms decreased to 44–57%.  Research highlights: The identification of apples with bitter pit through VIS/NIR spectroscopy may be due to chlorophyll degradation and/or changes in intercellular water in fruit tissue.
		</p>
		</abstract>
    </article-meta>
  </front>
  <body><sec>
			<title>Introduction</title>
				<p >Bitter pit is considered one of the key physiological disorders in apple crop, causing serious losses in certain apple varieties. The symptoms are characterized by depressions on the skin, generally located at the calyx end of the fruit. The tissue under these depressed areas is darkened, dry and corky with a bitter taste (Ferguson &amp; Watkins, 1989; Jemrić et al., 2016). Traditionally, research studies have related bitter bit with calcium deficiency and the balance between calcium and other nutrients such as nitrogen, potassium, or magnesium (Ferguson &amp; Watkins, 1989; Amarante et al., 2013; de Freitas et al., 2015). However, some works have shown a lack of relationship between calcium content level and bitter pit, indicating that the disorder could be affected by other causes such as climate and/or growing conditions (Saure, 1996, 2005; Lotze et al., 2008; Saure, 2014; Torres et al., 2017b).</p><p >Although the process that causes bitter pit usually starts during the period of fruit growth, the symptoms may not be evident in the orchard and generally appear during fruit storage or transport. This can result in extensive losses associated with labor and packing costs (Val et al., 2010; Kafle et al., 2016). Identifying fruit prone to bitter pit before export or shipment would help to reduce economic losses caused by market rejection (Nicolaï et al., 2006; Torres et al., 2015). Mineral analyses based on calcium levels within the fruit or approaches which force the appearance of symptoms before they naturally occur have been studied by different researchers to predict bitter pit (Torres et al., 2010, 2015, 2021; Jemrić et al., 2016; Kalcsits, 2016). The drawbacks of these techniques include the fact they are destructive, which means the same fruit cannot be monitored over time, and a delay of between 5 and 14 d before obtaining the results.</p><p >Measurements of spectral reflectance in the visible and near-infrared regions (VIS/NIR) using spectroscopy technology has several advantages (rapid measurement, repeatability, chemical-free and ability to measure multiple attributes simultaneously) over destructive methods (i.e. mineral analysis) which could help to overcome these difficulties. The VIS/NIR radiations penetrate the object, and changes in the spectral characteristics due to scattering and absorption depend on its chemical composition. These spectral changes provide information about microstructural properties of the object, including stiffness and internal damage. Many studies have explored the possibility of using VIS/NIR spectroscopy for studying quality and disorders or for detecting defects in apples (Upchurch et al., 1990; Mehl et al., 2002; Ariana et al., 2006; Xing et al., 2006; Paz et al., 2009).</p><p >As for bitter pit detection and/or prediction, very few studies have been published. Lotze (2005) made a classification between healthy and bitter pitted ‘Braeburn’ apples using fluorescence imaging with an accuracy of 75–100%. In another study, Nicolaï et al. (2006) used a line scan near-infrared camera with a spectrograph to capture spectral images and successfully identify visible and non-visible bitter pit lesions. Similarly, Ariana et al. (2006) presented an imaging model of reflectance and f luorescence to differentiate between pitted and non-pitted apples with accuracies of up to 87%. Recently, Kafle et al. (2016) and Jarolmasjed et al. (2017) distinguished bitter pitted apples by means of NIR spectrometry with an average accuracy in the range of 70–100%.</p><p >Most of the above-mentioned studies used laboratory equipment in the NIR region (780–2500 nm) and are of little practical use in the field or packing houses. In recent years, as the result of rapid technological developments, handheld VIS/NIR spectrometers have been designed to specifically control and monitor the quality and maturity of different fruits (León-Moreno, 2012). These spectrometers are portable and compact, but usually offer measurements only in limited wavelength ranges (&lt;1100 nm). According previous studies, these wavelength ranges could be enough to detect some disorders in apples. ElMasry et al. (2008) developed a hyperspectral imaging system based on a spectral region between 400 and 1000 nm for early detection of bruises on apples. Kleynen et al. (2005) observed that the 750 and 800 nm bands offered good contrast for detecting internal tissue damage like hail damage, bruises, and so forth.</p><p >The present study aims to evaluate the VIS/NIR spectroscopy technology for detecting and predicting bitter pit in apples. The specific goals of the study were: (1) to determine the capacity to classify different severity levels of bitter pit; (2) to determinate the capacity to classify healthy and bitter pitted apples carrying out one or two measures per fruit; and (3) to determine the capacity to predict bitter pit prior to the appearance of symptoms. To our knowledge, no results related to these specific objectives have been published to date.</p>
			</sec><sec>
			<title>Material and methods</title>
				<p >Plant material and selection of samples</p><p >‘Golden Smoothee’ apples (Malus domestica Borkh. L) were harvested on September 10th, 2015, and September 13th, 2016, from a bitter-pit-prone orchard located at Gimenells (Lleida, NE Spain). The orchard was planted in 1994 and trees were grafted onto M9 rootstock. Plant and row spacing were 1.4 m and 4 m, respectively (1786 trees/ha). Fertigation was applied through drip irrigation. The soil was characterized as a calcareous loam with excellent drainage characteristics. Trees were managed according to the guidelines for apple integrated production, including the application of mineral fertilizers that were estimated to cover the nutrient requirements.</p><p >Sampling of apples with visible bitter pit symptoms (experiment #1)</p><p >In 2015, average-sized apples (80–85 mm of diameter) at commercial harvest (September 2nd) were collected and placed in packaged fruit boxes and stored in cold storage at 0 °C for 4 months. Bitter pit was then evaluated using a category scale with 3 classes of bitter pit depending on the amount of pitted area (Fig. 1): class 1 with no bitter pit symptoms; class 2 with slight symptoms (fruit having 1–5 pits on the surface); class 3 with moderate/severe symptoms (more than 5 pits per fruit). Two 276-apple samples were selected. Each sample comprised 100 apples of class 1, 76 apples of class 2 and 100 apples of class 3 (Table 1). Two VIS/NIR measurements were carried out on each fruit (see sectionData collection).</p><p >Sampling of apples when bitter pit symptoms were not visible (experiment #2)</p><p >In 2016, healthy apples were collected at 20 d before harvest (at preharvest) and at commercial harvest (at harvest, September 8th). One average-sized (70–75 mm and 75–80 mm of diameter, repectively) and unda-maged apple was taken from different trees with standard crop loads and vigor at a height of 130–170 cm above the ground. The apples collected were subsequently placed on plastic fruit trays. Then, VIS/NIR measurements were carried out on each fruit when no symptom was visible (see sectionData collection).</p><p >After the VIS/NIR measurements, the apples collec-ted at preharvest were left at room temperature (~ 25 °C) to allow the development of bitter pit symptoms accor-ding to the passive method (Torres et al., 2015). After 7 d, bitter pit was evaluated using a binary-class classifi-cation: class 1 and class 3 (apples classified as class 2 were discarded for this experiment). Then, two balanced 40-apple samples were selected for bitter pit prediction at preharvest.</p><p >The apples collected at commercial harvest were kept, after the VIS/NIR measurements, in cold storage at 0 °C for 4 months; after this, bitter pit was evaluated using a bi-nary-class classification to separate apples without visual symptoms (class 1) from apples with visible BP symp-toms (class 3). Two 40-apple samples were selected for bitter pit prediction at harvest; each sample comprised 20 apples of class 1 (asymptomatic apples) and 20 apples of class 3 (symptomatic apples) (Table 1). Two VIS/NIR measurements were carried out on each fruit (see sectionData collection).</p><p ><fig><label>Figure</label><graphic xlink:href="e1001_fig_1.png"/></fig><bold>Figure 1.</bold>Category scale with three classes of bitter pit depending on the amount of pitted area: class 1 with no bitter pit symptoms; class 2 with slight symptoms (fruit having 1–6 pits on the surface); class 3 with moderate/severe symptoms (more than 6 pits per fruit).</p><p ><bold>Table 1.</bold>Number of collected spectral data for each dataset</p><p ><fig><label>Figure</label><graphic xlink:href="e1001_tab_1.png"/></fig>1Class 1: healthy apples without symptoms; class 2: bitter pit apples with slight symptoms (1–6 pits); class 3: Bitter pit apples with severe symptoms (&gt; 7 pits).2Two spectral data collected per fruit from two opposite sides. 3 DBH: days before harvest</p><p >Data collection</p><p >The spectral absorbance data were collected under la-boratory conditions using a UT-5001 portable handheld VIS/NIR spectrometer (UT instruments, Lugo, Ravenna, Italy) with measurement range of 650–950 nm, a range focuses on the red-border and near-infrared region and with high physiological factors such as changes in pigments, water, carbohydrates, chlorophyll content and fluorescence (Kurenda et al., 2014). The spectral resolution of the spectrometer was 2 nm. Fruits were equilibrated at room temperature approximately half a day before spectral acquisitions. A blank scan was performed using Teflon® before starting the spectral measurements of each sample. The VIS/NIR measurements were carried out from two opposite sides along the equator of the fruit.</p><p >In experiment #1, the first measurement was carried out on the most affected side when symptoms were visible, but on healthy area close to symptoms (symptomatic side); the second measurement was carried out on healthy area from the opposite side (non-symptomatic side).</p><p >For each experiment, two datasets were obtained from the measurement of each sample. The two datasets were combined to develop a new set of data. Finally, the spectral absorbance data of each experiment were analyzed as three datasets (Table 1).</p><p >Classification</p><p >Experiment #1: identification of bitter pitted apples</p><p >Each dataset was analyzed to evaluate the suitability of the spectral feature extraction in discriminating the identified class of bitter pit using a multiclass classification (class 1: non-BP; class 2: slight symptoms; class 3: severe symptoms) or a binary-class classification (classes 1 and 3). Differences between classification accuracies using measurements from different fruit sides (symptomatic, non-symptomatic and both fruit sides) were also analyzed. Each dataset was separated into a balanced training and testing dataset. The ratio of each dataset was 7:3 for model development and validation, respectively. The spectral feature extractions were evaluated using the algorithms LDA (linear discriminant analysis), QDA (quadratic discriminant analysis) and SVM (support-vector machine). The software used was The Unscrambler® (version 10.4; Camo Process AS, Oslo, Norway). The datasets were randomized three times each for evaluation of classifier performance.</p><p >Experiment #2: prediction of bitter-pit-prone apples</p><p >Each dataset was analyzed to evaluate the suitability of the spectral feature extraction in predicting the appearance of bitter pit, at preharvest and harvest, before the appearance of symptoms on the fruit surface. For this experiment, a binary classification was used (apples of class 1 and class 3). The VIS/NIR measurements were carried out from two opposite sides along the equator of the fruit. The spectral feature extractions were evaluated using three classification algorithms (LDA, QDA and SVM) for each case. Each dataset was separated into a balanced training and testing dataset as described above (training-testing ratio of 7:3).</p><p >Statistical analysis</p><p >Analyses were performed in SAS 9.2 (SAS Institute Inc., 2009). For experiment #1, a three-way interaction from binary logistic regression analysis was performed to test the main effects of ‘algorithm’ (LDA, QDA and SVM classifier models), ‘bitter pit class’ (1, 2, 3, overall or 1, 3, overall) and ‘fruit side’ (symptomatic, non-symptomatic and both fruit sides), and their interactions, on classification accuracies (percentage of correctly classified apples). For experiment #2, a two-way from binary logistic regression analysis was performed, for the pre- and harvest data, to test the main effects of ‘algorithm’ and ‘bitter pit class’ (1, 3, overall), and their interaction, on prediction accuracies.</p>
			</sec><sec>
			<title>Results</title>
				<p >Experiment #1</p><p >Multiclass classification accuracies</p><p >No significant differences were found between multiclass classification accuracies from different measured fruit sides (symptomatic, non-asymptomatic and both fruit sides). Nevertheless, the Chi-square test indicated a significant ‘algorithm × class’ interaction effect on classif ication accuracies (Table 2). Because of this significant interaction, algorithms were compared in each individual class (class 1, class 2 and class 3) and ‘overall’.</p><p >The average individual (class 1, 2 and 3) and overall multiclass classification accuracies, using the different classifier models (LDA, QDA and SVM), are shown in Fig. 2. The average overall classification accuracy was significantly higher using the LDA classifier than the QDA and SVM classifiers (50% vs. 42%). No significant differences between algorithms were found for class 1 (mean accuracy of 51%). The three classifier models (LDA, QDA and SVM) showed the lowest accuracies in class 2; LDA yielded an average class 2 classification accuracy significantly higher than QDA and SVM, and QDA obtained an accuracy significantly higher than SVM (37, 22 and 1%, respectively). For class 3, the average classification accuracy was significantly higher for SVM (65%) than LDA and QDA; no significant differences were found between LDA and QDA (52%).</p><p ><bold>Table2.</bold>p-values of Chi-square test from logistic regression analysis to test the main effects on classification accuracies (percentage of correctly classified apples) of ‘algori-thm’ (LDA, QDA and SVM classifier models), ‘bitter pit class’ (1, 2, 3, overall or 1, 3, overall) and ‘fruit side’ (symptomatic, non-symptomatic and both fruit sides), and their interactions, using VIS/NIR data when bitter pit symptoms were visible.<fig><label>Figure</label><graphic xlink:href="e1001_tab_2.png"/></fig>NS: p &gt; 0.05.</p><p ><fig><label>Figure</label><graphic xlink:href="e1001_fig_2.png"/></fig><bold>Figure 2.</bold>Comparison of average LDA-, QDA- and SVM-ba-sed multiclass (above) and binary (below) classification accura-cies (percentage of correctly classified apples), for each bitter pit class classification (class 1, class 2, class 3 and overall), using VIS/NIR data when bitter pit symptoms were visible. Error bars indicate the standard error of the mean. Class 1: no bitter pit symptoms; class 2: slight/moderate symptoms (1–6 pits on the surface); class 3: severe symptoms (more than 7 pits per fruit).</p><p >Binary classification</p><p >Binary classification showed significantly higher ac-curacies than multiclass classification, independently of the classifier model. No significant differences were found for the effect of different fruit sides (symptomatic, non-asymptomatic and both fruit sides) on binary classification accuracies (Table 2). As in the multiclass classifi-cation, the Chisquare test indicated a significant ‘algorithm × class’ interaction effect on classification accuracies. Because of this significant interaction, algorithms were compared in each individual class (healthy-class and bit-ter pit-class) and overall.</p><p >The average individual (class 1 and 3) and overall bi-nary-class classification accuracies, using the different classifier models (LDA, QDA and SVM), are shown in Fig. 2. As in the multiclass classification, the average overall classification accuracy was significantly higher using the LDA classifier than the QDA and SVM classifiers; QDA produced an overall classification accuracy significantly higher than SVM (75%, 65% and 57%, respectively).</p><p >The average class 1 (asymptomatic apples) classification accuracy was also significantly higher using LDA than QDA and SVM, and QDA showed a significantly higher accuracy than SVM (81%, 59% and 49%, respec-tively). The classification accuracy of class 3 (sympto-matic apples) using QDA was significantly higher than when using LDA or SVM (71% vs. 67%); no significant differences between LDA and SVM were observed. The accuracy average of class 1 was significantly higher than of class 3 using LDA (81% vs. 68%), whereas using QDA and SVM the accuracies were higher for class 3 than for class 1 (59% vs. 71% and 49% vs. 65%).</p><p >These results indicate that the LDA classifier yielded a higher number of false positives (healthy apples identified as bitter pitted apples), whereas the QDA and SVM classifiers yielded a higher number of false negatives (bitter pitted apples classified as healthy).</p><p >A visual inspection of the absorbance curves indicated that the greatest differences between pitted (class 3) and non-pitted (class 1) apples were in the VIS region of 650700 nm and in the NIR region of 900–950 nm (Fig. 4).</p><p >Experiment #2</p><p >Within each prediction time (preharvest and harvest), no significant differences in classification accuracies were found between the different classifier models or the dif ferent classification classes (Table 3). The average individual (class 1 and 3) and overall classification accuracies, using the different classifier models (LDA, QDA and SVM), are shown in Fig. 4, for both prediction times (at preharvest and at harvest, respectively). In both prediction times, the classification accuracies prior to the appearance of bitter pit were lower than when bitter pit was visible, independently of the classifier model. The average overall accuracies were of 44% (LDA), 40% (QDA) and 51% (SVM) at preharvest, and of 57% (LDA), 58% (QDA) and 47% (SVM) at harvest, with no significant difference between the different classifier models (Fig. 4). These results indicate that VIS/NIR spectra were not capable of accurately detecting bitter pit prone fruit.</p>
			</sec><sec>
			<title>Discussion</title>
				<p >The visual inspection of the absorbance curves indicated that the greatest differences between pitted and non-pitted apples were in the VIS region of 650–700 nm and in the NIR region of 900–950 nm. A fruit spectrum in this wavelength range is strongly affected by the presence of the red light absorbing skin pigment chlorophyll which represent the color characteristics in the fruit (Abbott et al., 2010). Chlorophyll a absorbs light at ~660 nm, while chlorophyll b absorbs ~640 nm. As the fruit mature, the chlorophyll decreases and so does the red-light absorption with the consequential loss of green coloring. The reflected red wavelengths, combined with reflected green wavelengths, is perceived by the human eye as yellow. In this respect, immature fruit are more susceptible to bitter pit than fruit harvested at the proper maturity (Prange et al., 2011). Hence, the skin chlorophyll content could be a reliable measure of bitter pit risk. Changes in this wavelength range are also used as indicative of stress or nutrient deficiencies. Plant stress is typically accompanied by a reduction or shutdown in photosynthesis, the effect of which is a reduction in the absorption (i.e. a higher reflectance) of blue and red wavelengths. In short, changes in the absorption range around 650–700 nm may reflect a combination of reactions of fruit physiology and maturity and hence, it could be interpreted as indicative of bitter pit. The NIR region of 900–950 nm is associated with the water content or dry matter. ElMasry et al. (2008) defined in apples the absorption valleys in the NIR at 840–960 nm as sugar and water absorption bands. Similar findings were reported by Travers et al. (2014) in pears who observed that the NIR region between 900–970 nm was important for dry matter and soluble solids. In our case, the differences observed in this NIR region could be attributed to the fact that in bruised areas, such as bitter pit-like symptoms, water replaces the intercellular air spaces in the plant tissue and, consequently, could cause a decrease in NIR-reflectance of these areas.</p><p >Multiclass classification overall accuracies were from 42% (QDA and SVM) to 50% (LDA). Class 2 (slight symptoms, with fruit having 1–5 pits on the surface) showed accuracies significantly lower than for the other two classes and overall accuracies, independently of algorithm (1–37%). The imbalance of the class distribution in the training data (100, 76, 100) could have led to classification algorithms overestimate the majority classes (class 1 and 3). The lack of accuracy could be also attributed to the low degree to which the apples were affected. In order to reduce these errors, we rejected class 2 apples for the binary-class classification.</p><p >The binary-class classification resulted in accuracies significantly higher than for multiclass classification. The overall accuracy of the binary-class classification was 75% using the LDA classifier model. These results are similar to those obtained by other researchers for discriminating between healthy and bitter pitted apples using a binary-class classification (Nicolaï et al., 2006; Kafle et al., 2016; Jarolmasjed et al., 2017). The LDA classifier accuracies were significantly higher than those of the QDA and SVM classifiers, and QDA (65%) was found to yield higher accuracies than SVM (57%). Kafle et al. (2016) also reported that QDA had a higher classification accuracy than SVM of healthy and bitter pitted apples, with accuracy values similar to those obtained in the present study.</p><p >The accuracy level in each class depended on the classifier model used. QDA and SVM showed higher accuracies for class 3 (bitter pitted apples), whereas classification accuracies of LDA were significantly higher for class 1 (asymptomatic apples). This indicates that LDA classifiers yielded a higher number of false positives (healthy apples identified as bitter pitted apples), whereas QDA and SVM classifiers yielded a higher number of false negatives (bitter pitted apples classified as healthy). These results contrast with those obtained in a similar experiment with Honeycrisp apples performed by Kafle et al. (2016), who obtained a significant increase for healthy-apple class accuracies compared to bitter-pitted-apple class using QDA and SVM algorithms. Jarolmasjed et al. (2017) obtained a higher number of false negatives than false positives using partial least square regression. Further studies with larger datasets need to be performed to validate these aspects because algorithm performance arguably depends on several factors which might be responsible for the different results (Sankaran &amp; Ehsani, 2011; Kafle et al., 2016).</p><p >It was observed that classification accuracies did not change significantly when measuring different fruit sides (symptomatic, asymptomatic or both). VIS/NIR spectroscopy point meter readings measure a limited area (10 mm diameter circle) per measurement. This aspect may limit the application of NIR technology to detect affected apples due to the inability to take measurements on affected areas (Lotze, 2005). However, the signature of organic and complex compounds of major chemical contents associated with bitter pit (calcium, magnesium, and potassium) might exist in spectral data obtainable by VIS/NIR spectroscopy (Jarolmasjed et al., 2017). Hence, it would be possible to detect – even prior to the appearance of visible symptoms – bitter pitted apples based on the chemical contents of the fruit, independently of whether the measurement is made on the bitter pit lesion. Our results indicate that the VIS/NIR-spectroscopy method offers potential for non-destructive discrimination of bitter pitted from healthy apples, independently of measured fruit area. This would facilitate the development of a model for implementation in portable handheld VIS/NIR spectrometers or in automatic apple sorting systems.</p><p >VIS/NIR spectroscopy readings were however unable to identify immature (preharvest) or mature apples (harvest) more prone to bitter pit development prior to the appearance of visible symptoms. Lotze (2005) proposed that the inability of VIS/NIR spectroscopy point meter readings to identify bitter pit prone fruit could be due to not being able to take measurements on the affected areas. However, we did not observe this limitation in experiment #1 when the bitter pit symptoms were visible. According our results, the identification of apples with visible bitter pit through VIS/NIR spectroscopy may be due to chlorophyll degradation and/or changes in intercellular water in fruit tissue and, from our point of view, these changes would not have developed before the appearance of symptoms. We suggest that bitter pit prone apples could be detected through the relationship of mineral content associated with bitter pit (calcium, magnesium, and potassium) but, according recent studies, a higher wavelength range will be necessary for these cases. Bonomelli et al. (2020) did not observe correlations in apple tissues between calcium content and reflectance spectrum between 285–1200 nm. On the other hand, Galvez-Sola et al. (2015) and Jarolmasjed et al. (2017) obtained a strong relationship between the spectral features and the calcium content in apples and citrus leaves, respectively, using wavelength ranges from 830–2600 nm. Along this line, a future work using a higher wavelength range (&gt;900 nm) will investigate a possible relationship between NIR spectral features and mineral content at an early stage of fruit growth to predict bitter pit potential. Further work will be necessary to develop calibration including data covering an appropriate range of instrumental, biological and environmental conditions to build more robust models applicable independently of external factors.</p><p ><fig><label>Figure</label><graphic xlink:href="e1001_fig_3.png"/></fig><bold>Figure 3.</bold>Average VIS/NIR spectra of healthy (black line) and bitter pitted (dotted line) apples.</p><p ><bold>Table 3.</bold>p-values of Chi-square test from logistic regression analysis to test the main effects on classification accuracies (percentage of correctly classified apples) of ‘algorithm’ (LDA, QDA and SVM classifier models) and ‘bitter pit class’ (1, 3, overall), and their interaction, using VIS/NIR data when bitter pit symptoms were not visible. ‘Preharvest’: NIR measured at 20 d before harvest on healthy apples and bitter pit symptoms assessed after 7–10 d at room temperature (22–25 ºC). ‘Postharvest’: NIR measured at harvest on healthy apples and bitter pit symptoms assessed after 4 months in cold storage (0 ºC).</p><p ><fig><label>Figure</label><graphic xlink:href="e1001_tab_3.png"/></fig>NS: p &gt; 0.05.</p><p ><fig><label>Figure</label><graphic xlink:href="e1001_fig_4.png"/></fig><bold>Figure 4.</bold>Comparison of average LDA-, QDA- and SVM-based binary classification accuracies (percentage of correctly classified apples), for each bitter pit class classification (class 1, class 3 and overall), using VIS/NIR data on healthy apples at 20 days before harvest (DBH) and bitter pit symptoms assessed after 10 d at room temperature, and at harvest on healthy apples and bitter pit symptoms assessed after 4 months in cold storage at 0 ºC. Error bars indicate the standard error of the mean.</p>
			</sec><sec>
			<title>References</title>
				<table-wrap><label>Table</label><table><tr></tr><tr><td>○</td><td>Abbott JA, Lu R, Upchurch BL, Stroshine, RL, 2010. Technologies for nondestructive quality evaluation of fruits and vegetables. Hortic Rev 20: 1-120.https://doi.org/10.1002/9780470650646.ch1</td></tr><tr><td>○</td><td>Amarante CVT, Miqueloto A, de Freitas ST, Steffens CA, Silveira JPG, Corrêa TR, 2013. Fruit sampling methods to quantify calcium and magnesium contents to predict bitter pit development in 'Fuji' apple: a multivariate approach. Sci Hortic 157: 19-23.https://doi.org/10.1016/j.scienta.2013.03.021</td></tr><tr><td>○</td><td>Ariana D, Guyer DE, Shrestha B, 2006. Integrating multispectral reflectance and fluorescence imaging for defect detection on apples. Comput Electron Agric 50: 148-161.https://doi.org/10.1016/j.compag.2005.10.002</td></tr><tr><td>○</td><td>Bonomelli C, Mogollón R, de Freitas ST, Zoffoli, JP, Contreras C, 2020. Nutritional relationships in bitter pit-affected fruit and the feasibility of VIS-NIR models to determine calcium concentration in 'Fuji' apples. Agronomy 10 (10): 1476.https://doi.org/10.3390/agronomy10101476</td></tr><tr><td>○</td><td>de Freitas ST, Amarante CVT, Mitcham EJ, 2015. Mechanisms regulating apple cultivar susceptibility to bitter pit. Sci Hortic 186: 54-60.https://doi.org/10.1016/j.scienta.2015.01.039</td></tr><tr><td>○</td><td>ElMasry G, Wang N, Vigneault C, Qiao J, ElSayed A, 2008. Early detection of apple bruises on different background colors using hyperspectral imaging. LWT - Food Sci Technol 41: 337-345.https://doi.org/10.1016/j.lwt.2007.02.022</td></tr><tr><td>○</td><td>Ferguson IB, Watkins CB, 1989. Bitter pit in apple fruit. Hortic Rev 11: 289-355.https://doi.org/10.1002/9781118060841.ch8</td></tr><tr><td>○</td><td>Galvez-Sola L, García-Sánchez F, Pérez-Pérez JG, Gimeno V, Navarro J M, Moral R, Martínez-Nicolás JJ, Nieves M, 2015. Rapid estimation of nutritional elements on citrus leaves by near infrared reflectance spectroscopy. Front Plant Sci 6: 571.https://doi.org/10.3389/fpls.2015.00571</td></tr><tr><td>○</td><td>arolmasjed S, Zúñiga Espinoza C, Sankaran S, 2017. Near infrared spectroscopy to predict bitter pit development in different varieties of apples. J Food Meas Charact 11 (3): 987-993.https://doi.org/10.1007/s11694-017-9473-x</td></tr><tr><td>○</td><td>emrić T, Fruk I, Fruk M, Radman S, Sinkovič L, Fruk G, 2016. Bitter pit in apples: pre-and postharvest factors - A review. Span J Agric Res 14 (4): e08R01.https://doi.org/10.5424/sjar/2016144-8491</td></tr><tr><td>○</td><td>Kafle GK, Khot LR, Jarolmasjed S, Yongsheng S, Lewis K, 2016. Robustness of near infrared spectroscopy based spectral features for non-destructive bitter pit detection in honeycrisp apples. Postharvest Biol Technol 120: 188-192.https://doi.org/10.1016/j.postharvbio.2016.06.013</td></tr><tr><td>○</td><td>Kalcsits LA, 2016. Non-destructive measurement of calcium and potassium in apple and pear using handheld x-ray fluorescence. Front Plant Sci 7: 442.https://doi.org/10.3389/fpls.2016.00442</td></tr><tr><td>○</td><td>Kleynen O., Leemans V., Destain, MF, 2005. Development of a multi-spectral vision system for the detection of defects on apples. J Food Eng 69 (1): 41-49.https://doi.org/10.1016/j.jfoodeng.2004.07.008</td></tr><tr><td>○</td><td>Kurenda A, Zdunek A, Schlüter O, Herppich WB, 2014. VIS/NIR spectroscopy, chlorophyll fluorescence, biospeckle and backscattering to evaluate changes in apples subjected to hydrostatic pressures. Postharvest Biol Technol 96: 88-98.https://doi.org/10.1016/j.postharvbio.2014.05.009</td></tr><tr><td>○</td><td>León-Moreno L, 2012. Usefulness of portable near infrared spectroscopy in olive breeding programs. Span J Agric Res 10 (1): 141-148.https://doi.org/10.5424/sjar/2012101-184-11</td></tr><tr><td>○</td><td>Lotze E, 2005. Pre-harvest determination of bitter pit potential in apples. Doctoral thesis. Univ. of Stellenbosch, Stellenbosch, South Africa.</td></tr><tr><td>○</td><td>Lotze E, Joubert J, Theron KI, 2008. Evaluating pre-harvest foliar calcium applications to increase fruit calcium and reduce bitter pit in 'Golden Delicious' apples. Sci Hortic 116: 299-304.https://doi.org/10.1016/j.scienta.2008.01.006</td></tr><tr><td>○</td><td>Mehl PM, Chao K, Kim M, Chen YR, 2002. Detection of defects on selected apple cultivars using hyperspectral and multispectral image analysis. Appl Eng Agric 18: 219-226.https://doi.org/10.13031/2013.7790</td></tr><tr><td>○</td><td>Nicolaï BM, Lotze E, Peirs A, Scheerlinck N, Theron KI, 2006. Non-destructive measurement of bitter pit in apple fruit using NIR hyperspectral imaging. Postharvest Biol Technol 40: 1-6.https://doi.org/10.1016/j.postharvbio.2005.12.006</td></tr><tr><td>○</td><td>Paz P, Sánchez MT, Pérez‐Marín D, Guerrero JE, Garrido‐Varo A, 2009. Evaluating NIR instruments for quantitative and qualitative assessment of intact apple quality. J Sci Food Agric 89 (5): 781-790.https://doi.org/10.1002/jsfa.3512</td></tr><tr><td>○</td><td>Prange R, Delong J, Nichols D, Harrison P, 2011. Effect of fruit maturity on the incidence of bitter pit, senescent breakdown, and other post-harvest disorders in 'Honeycrisp'TM apple. J Hortic Sci Biotechnol 86 (3): 245-248.https://doi.org/10.1080/14620316.2011.11512756</td></tr><tr><td>○</td><td>Sankaran S, Ehsani R, 2011. Visible-near infrared spectroscopy based citrus greening detection: Evaluation of spectral feature extraction techniques. Crop Prot 30: 1508-1513.https://doi.org/10.1016/j.cropro.2011.07.005</td></tr><tr><td>○</td><td>Saure MC, 1996. Reassessment of the role of calcium in development of bitter pit in apple. Aus J Plant Physiol 23: 237-243.https://doi.org/10.1071/PP9960237</td></tr><tr><td>○</td><td>Saure MC, 2005. Calcium translocation to fleshy fruit: its mechanism and endogenous control. Sci Hortic 105: 65-89.https://doi.org/10.1016/j.scienta.2004.10.003</td></tr><tr><td>○</td><td>Saure MC, 2014. Why calcium deficiency is not the cause of blossom-end rot in tomato and pepper fruit: a reappraisal. Sci Hortic 174: 151-154.https://doi.org/10.1016/j.scienta.2014.05.020</td></tr><tr><td>○</td><td>Torres E. and Alegre S, 2012. Predicting bitter pit in 'golden smoothee' apples. Acta Hortic. 934: 861-864https://doi.org/10.17660/ActaHortic.2012.934.114</td></tr><tr><td>○</td><td>Torres E, Recasens I, Peris JM, Alegre S, 2015. Induction of symptoms pre-harvest using the 'passive method': an easy way to predict bitter pit. Postharvest Biol Technol 101: 66-72.https://doi.org/10.1016/j.postharvbio.2014.11.002</td></tr><tr><td>○</td><td>Torres E, Recasens I, Àvila G, Lordan J, Alegre S, 2017a. Early stage fruit analysis to detect a high risk of bitter pit in 'Golden Smoothee'. Sci Hortic 219: 98-106.https://doi.org/10.1016/j.scienta.2017.03.003</td></tr><tr><td>○</td><td>Torres E, Recasens I, Lordan J, Alegre S, 2017b. Combination of strategies to supply calcium and reduce bitter pit in 'Golden Delicious' apples. Sci Hortic 217: 179-188.https://doi.org/10.1016/j.scienta.2017.01.028</td></tr><tr><td>○</td><td>Torres E, Alegre S, Recasens I, Asín L, Lordan J, 2021. Integral procedure to predict bitter pit in 'Golden Smoothee' apples based on calcium content and symptom induction. Sci Hortic 277: 109829.https://doi.org/10.1016/j.scienta.2020.109829</td></tr><tr><td>○</td><td>Travers S, Bertelsen MG, Petersen KK, Kucheryavskiy SV, 2014. Predicting pear (cv. Clara Frijs) dry matter and soluble solids content with near infrared spectroscopy. LWT - Food Sci Technol 59 (2): 1107-1113.https://doi.org/10.1016/j.lwt.2014.04.048</td></tr><tr><td>○</td><td>Upchurch BL, Affeldt HA, Hruschka WR, Nonis KH, Throop JA, 1990. Spectrophotometric study of bruises on whole, 'Red Delicious' apples. T ASAE 33: 585-0589.https://doi.org/10.13031/2013.31370</td></tr><tr><td>○</td><td>Val J, Fernández V, López P, Peiró JM, Blanco A, 2010. Low oxygen treatment prior to cold storage decreases the incidence of bitter pit in 'Golden Reinders' apples. J Sci Food Agric 90: 536-540.https://doi.org/10.1002/jsfa.3837</td></tr><tr><td>○</td><td>Xing J, Bravo C, Moshou D, Ramon H, De Baerdemaeker J, 2006. Bruise detection on 'Golden Delicious' apples by VIS/NIR spectroscopy. Comp Electron Agric 52: 11-20.https://doi.org/10.1016/j.compag.2006.01.006</td></tr></table></table-wrap>
			</sec></body>
  <back>
    <ack>
      <p>The authors are grateful to ACTEL, especially to Mr. Carlos Faro and to their growers for providing the orchards, Núria Farre for laboratory suport, and to UT instruments Srl, especially to Enrico Turoni, for lending us the portable handheld VIS/NIR spectrometer.</p>
    </ack>
  </back>
</article>