Crop Science Illumina
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Published online 20 May 2008
Published in Crop Sci 48:866-889 (2008)
© 2008 Crop Science Society of America
677 S. Segoe Rd., Madison, WI 53711 USA
This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Gauch, H. G.
Right arrow Articles by Annicchiarico, P.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Gauch, H. G., Jr.
Right arrow Articles by Annicchiarico, P.
Agricola
Right arrow Articles by Gauch, H. G.
Right arrow Articles by Annicchiarico, P.
Related Collections
Right arrow Plant and Environment Interactions
Right arrow Crop Genetics
Right arrow Statistics

Statistical Analysis of Yield Trials by AMMI and GGE: Further Considerations

Hugh G. Gauch, Jr.a,*, Hans-Peter Piephob and Paolo Annicchiaricoc

a Crop and Soil Sciences, Cornell Univ., Ithaca, NY 14853
b Bioinformatics Unit, Institut für Pflanzenbau und Grünland, Universität Hohenheim, 70599 Stuttgart, Germany
c CRA-Istituto Sperimentale per le Colture Foraggere, Viale Piacenza 29, 26900 Lodi, Italy

* Corresponding author (hgg1{at}cornell.edu).


    ABSTRACT
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
Recent review articles in this journal have compared the relative merits of two prominent statistical models for analyzing yield-trial data: Additive main effects and multiplicative interaction (AMMI) and genotype main effects and genotype x environment interaction (GGE). This review addresses more than 20 issues that require clarification after controversial statements and contrasting conclusions have appeared in those recent reviews. The AMMI2 mega-environment display incorporates more of the genotype main effect and captures more of the genotype x environment (GE) interaction than does GGE2, thereby displaying the which-won-where pattern more accurately for complex datasets. When the GE interaction is captured well by one principal component, the AMMI1 display of genotype nominal yields describes winning genotypes and adaptive responses more simply and clearly than the GGE2 biplot. For genotype evaluation within a single mega-environment, a simple scatterplot of mean and stability is more straightforward than the mean vs. stability view of a GGE2 biplot. Diagnosing the most predictively accurate member of a model family is vital for either AMMI or GGE, both for gaining accuracy and delineating mega-environments.

Abbreviations: AEC, average environment coordinate • AMMI, additive main effects and multiplicative interaction • ANOVA, analysis of variance • E, environment • EGE, environment main effects and genotype x environment interaction • G, genotype • GE, genotype x environment • GGE, genotype main effects and genotype x environment interaction • GL, genotype x location • PC, principal component • PCA, principal components analysis • QTL, quantitative trait locus • RHS, right-hand side • SS, sum of squares • SSG, sum of squares for genotype • SSGE, sum of squares for genotype x environment • SV, singular value • SVD, singular value decomposition • SVP, singular value partitioning


    INTRODUCTION
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
THE YIELD TRIAL is one of the most common and important experiments in agricultural research, typically testing a number of genotypes in a number of environments, often for additional traits as well as yield. Accordingly, statistical methods for effective analysis of yield trials have received considerable development and discussion. Two frequently used models for statistical analyses have been the additive main effects and multiplicative interaction (AMMI) model and the genotype main effects and genotype x environment interaction effects (GGE) model.

Recent review articles in Crop Science have compared these analyses. Gauch (2006a) reviewed the AMMI and GGE literatures, favoring AMMI. More recently, Yan et al. (2007) responded to that article, favoring GGE. However, Yan et al. (2007) contains several errors and fails to respond to some critiques of GGE in Gauch (2006a). Consequently, the issues require further consideration.

Gauch (2006a) argues that AMMI's and GGE's relative merits depend on the research purpose. For the research purpose of producing graphical visualizations of patterns in yield-trial data, AMMI is superior because an AMMI1 biplot has a simpler and more informative geometry than a GGE2 biplot, and the AMMI2 biplot, which has no GGE counterpart, can capture substantially more variation. Furthermore, the AMMI1 biplot serves crop and soil scientists simultaneously because it displays genotype (G) main effects, environment (E) main effects, and genotype x environment (GE) interaction effects, whereas the GGE2 biplot shows only the G and GE effects of interest to crop scientists and soil scientists would need another biplot, which could be called the environment main effects and genotype x environment interaction effects (EGE) biplot, showing the E and GE effects of interest to them. For the research purpose of delineating mega-environments, both AMMI and GGE are suitable, and comparisons so far indicate similar results, as expected. For the research purpose of gaining accuracy, AMMI and GGE (and the shifted multiplicative model and so on) are all equally capable.

The review by Yan et al. (2007) addresses five main topics. It begins by identifying three major aspects of yield-trial analysis: (i) mega-environment delineation, (ii) genotype evaluation, and (iii) test-environment evaluation. Accordingly, that review's three figures showcase the GGE biplots used to address these objectives, namely, the "which-won-where," "mean vs. stability," and "discriminating power vs. representativeness" views. It then discusses the fundamental differences in theory between the AMMI and GGE perspectives, claiming that (iv) G and GE are best analyzed jointly and they are interchangeable. Finally, that review claims that (v) accuracy gain from model diagnosis should not be overstated.

To facilitate comparison of the Yan et al. (2007) review and the present review, we follow this same order of topics. Because the literature has already been reviewed recently twice, this paper does not again review the literature but rather focuses on Yan et al. (2007).

This paper has four objectives: (i) to correct several errors and to emphasize neglected opportunities in the GGE literature so that researchers who prefer GGE analysis can obtain considerably more reliable and effective results; (ii) to demonstrate that some research objectives accomplished by graphical displays in the GGE literature can be accomplished more simply, directly, and satisfactorily by AMMI-based graphs, scatterplots, or tabular presentations; (iii) to respond to over 20 criticisms of AMMI and counter-claims favoring GGE in Yan et al. (2007); and (iv) to maintain that AMMI is singularly appropriate for crop and soil scientists because AMMI can separate the main and interaction effects that present researchers with such different problems and opportunities, whereas GGE combines G and GE and thereafter can never separate them as crop scientists require and GGE ignores E of importance to soil scientists.


    MODELS AND TERMINOLOGY
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
Both AMMI and GGE combine analysis of variance (ANOVA) for additive parameters and singular value decomposition (SVD) for multiplicative parameters, the principal components (PCs). In the present context of agricultural research, consider a GE two-way factorial design, with Yge the yield for genotype g in environment e.

For the additive parameters, let µ be the grand mean, µg the mean for genotype g (over environments), and µe the mean for environment e (over genotypes). Also let {alpha}g = µg – µ be the genotype deviation and βe = µe µ be the environment deviation.

For the multiplicative parameters, for component n, let {lambda}n be the singular value for that component (and correspondingly {lambda}2n its eigenvalue), let {gamma}gn be the eigenvector value for genotype g and let {delta}en be the eigenvector value for environment e, with both eigenvectors scaled as unit vectors, {Sigma}g{gamma}2gn = {Sigma}e{delta}2en = 1. Usually, not all components are retained in the model, so a reduced model also has a residual term, {rho}ge.

Let NG be the number of genotypes and NE the number of environments. Then the full model, leaving no residual, has minimum(NG – 1, NE – 1) components for AMMI and min(NG, NE–1) components for GGE. The number of components for a particular member of an AMMI or GGE model family can be indicated by adding that number as a suffix, such as AMMI1 with one component or GGE2 with two. The full models with all components are designated by AMMIF and GGEF. At the opposite extreme, the AMMI model with no components, which has just the ANOVA portion of the model, is designated by AMMI0 (it has no GGE counterpart).

Two additional terms, {theta}ge and {nu}ge, will be introduced below. They will serve to focus attention on the values submitted to SVD.

The AMMI model equation may be written as

Formula 1[1]
Another useful form of this model equation results from switching from deviations to means for the additive part, rearranging the terms to put the additive part on the left and the multiplicative part on the right, and defining {theta}ge to be the interaction

Formula 2[2]
Yet another useful form results from switching from actual yields Y to model estimates Y' for the selected member of the model family, such as AMMI2:

Formula 3[3]
The GGE model may be written as

Formula 4[4]
The term defined in this expression, {nu}ge, does not yet have a name in the GGE literature, so environment-centered yields is adopted here. A related quantity, Yge – βe or the actual yields minus environment deviations, has been termed nominal yields in the AMMI literature (Gauch and Zobel, 1997); we propose this name. Obviously, using actual or environment-centered or nominal yields does not affect genotype differences or rankings within each environment. But it does affect SVD.

The GGE2 member of the model family may be written as

Formula 5[5]
The only difference between the AMMI and GGE model equations is that AMMI does, and GGE does not, subtract the genotype effects before performing SVD. Consequently, the multiplicative parameters have different values in Eq. [2] and [4] because SVD is applied to different matrices: interactions for AMMI and environment-centered yields for GGE. Before the name AMMI was introduced by Gauch (1988) and Zobel et al. (1988) and the name GGE by Yan et al. (2000), these models were called doubly centered principal components analysis (PCA) and environment-centered PCA.

The multiplicative term, {lambda}{gamma}g{delta}e, requires two multiplications to be evaluated, so for convenience, the singular value {lambda} is usually incorporated into the genotype and/or environment results to obtain "scores" whose products give this term with a single multiplication. Any choice of the arbitrary constant z for {lambda}z{gamma}g and {lambda}1–z{delta}e gives the intended product, but certain choices of z are preferable for various purposes.

Three simple choices of z prevail in the literature. The usual partition in the AMMI literature is genotype and environment scores of {lambda}0.5{gamma}g and {lambda}0.5{delta}e. The two common partitions in the GGE literature are genotype-focused singular value partitioning, {lambda}{gamma}g and {delta}e, and environment-focused partitioning, {gamma}g and {lambda}{delta}e. Yan et al. (2007) denote these by singular value partitioning (SVP) = 1 and SVP = 2, respectively. They also mention a symmetric scaling using {lambda}0.5{gamma}g and {lambda}0.5{delta}e.

For any component, for SVP = 1, the sum of squares (SS) for genotype scores equals {lambda}2 and for environment scores equals 1. For SVP = 2, the SS for genotype scores equals 1 and for environment scores it equals {lambda}2. For symmetric scaling, the SS for genotype scores and for environment scores is {lambda}.

Because {lambda} can easily be far larger (or smaller) than 1, a biplot with SVP = 1 or SVP = 2 can have one set of markers reduced to a tiny region, or even a microscopic speck. Accordingly, biplots are often rescaled to give both sets of markers similar ranges or areas, thereby improving legibility (Digby and Kempton, 1987, pp. 63–67; Yan and Kang, 2002, pp. 42–49). Multiplying genotype scores for both axes by any value s leaves the interpretation of the biplot unaltered, while simultaneously multiplying the environment scores for both axes by 1/s also leaves the cross products of genotype and environment scores unaltered (so they approximate {theta}ge in Eq. [2] for AMMI or {nu}ge in Eq. [4] for GGE). Several procedures for choosing s have been proposed, but since the distributions of markers are variable, no single default procedure has prevailed. Although the choice of s leaves the interpretation unaltered, to make a biplot reproducible, any axis rescaling must be reported. After both singular value (SV) partitioning and axis rescaling, four sets of scores result: s{lambda}1z{gamma}g1, s {lambda}2z{gamma}g2, ({lambda}11–z/s){delta}e1, and ({lambda}21–z/s){delta}e2.

Both axes must have the same scale to preserve biplot properties. Otherwise, an unequal scaling "is useless for appreciating distances and angles, including orthogonal projections, which are vital for interpreting biplots" (Gower and Hand, 1996, p. 20).

Because the units of Y are yield (in kg ha–1 or whatever), all terms in the above equations must also be in the units of yield, including {lambda}{gamma}g{delta}e. But because this term is partitioned into a genotype score and an environment score that need to be discussed and used individually, units must also be assigned to these scores. One choice is to deem the eigenvectors to be without units and attach the units of yield to {lambda}. But for SVP = 1 (or SVP = 2), this choice has the quite awkward implication of giving units of yield to genotype scores but no units to environment scores (or the reverse). Consequently, the preferable choice is to attach units of the square root of yield to both genotype scores and environment scores, regardless of how {lambda} is distributed between them and regardless of any axis rescaling. Because this attribution, giving all scores the same units, best accords with customary practice in both the AMMI and GGE literatures, it is adopted here.

Having recommended attribution of the units of yield0.5 to all PC scores—for both AMMI and GGE and for any partitioning of the singular value—products of genotype and environment scores are in the correct units of yield. But for both AMMI and GGE, these products, for either a given component or for a sum of components (including the full model), are in units of yield but are not approximating or equaling actual yields. The multiplicative portion of AMMI concerns {theta}, that is, interactions. And the multiplicative portion of GGE concerns {nu}, that is, nominal yields. In the literature, the products {lambda}{gamma}g{delta}e are sometimes taken to be approximating "yields," but such loose terminology is better avoided because these products approximate interactions in AMMI and environment-centered yields in GGE. Only if SVD were applied directly to the actual data matrix, without subtraction of anything first, would these products approximate the actual yields.

Because the term biplot has been applied by different authors in variously strict or broad senses, we must specify the sense intended here. Biplots provide visualizations for two-way data matrices, namely, GE matrices in the present context of yield-trial research, or row-by-column matrices to use more generic terminology. The foremost feature of a biplot, from which it takes its name, is a graph with markers (points or lines or arrows) for each row and markers for each column of a data matrix. Another important feature of a biplot, emphasized by Gabriel (1971) and Kempton (1984), is the inner-product property. The inner product of the genotype and environment vectors approximates the entries in the matrix submitted to SVD, where the two dimensions ordinarily used to display PC1 and PC2 provide the rank 2 approximation.

Three kinds of biplots are discussed in this paper. The AMMI1 biplot shows genotype and environment means and the grand mean on the abscissa and its PC1 scores for genotypes and environments on the ordinate. The AMMI2 biplot shows its PC1 on the abscissa and PC2 on the ordinate. And the GGE2 biplot shows its PC1 on the abscissa and PC2 on the ordinate.

If markers are shown for rows (or columns) of special interest, rather than all rows to reduce clutter, we would still call such a graph a biplot. Likewise, were row markers shown in one panel of a graph and column markers in another panel, that graph would still be deemed a biplot. And if additional information is added beyond the row and column markers—such as the polygon and rays used to delineate GGE2 mega-environments, or interpretive information on causal factors, or arrows representing environmental covariates (ter Braak, 1986)—our preference is to call such a graph an augmented biplot. In a calibrated predictive biplot, the environments are represented by scaled axes rather than vectors so that projections of genotype markers onto environmental axes allow predicted values to be read directly (Gower and Hand, 1996, p. 23–30). If markers for rows and markers for columns are present, but the inner-product property is absent (as in an AMMI1 biplot with means on the abscissa and PC1 on the ordinate), our inclination is to consider this a biplot in the broad sense while acknowledging that some others may prefer to deem this a graph or display. However, if one set of markers is replaced by a set of regions (such as AMMI2 mega-environments with markers for all genotypes replaced by regions for winning genotypes), then graph or display seems to be a more appropriate name.

Finally, it may be emphasized that the data structure addressed by AMMI, GGE, and related analyses is a two-way factorial design having one kind of data (such as yield), either replicated or not. Some yield trials produce additional data structures, including a three-way factorial of genotypes x locations x years, a data matrix with a different variable in each row (or column), and a matrix of environmental measurements as well as the matrix of yield data (Gauch, 1992, p. 102–106). Those complex data structures require other statistical models or in some cases may conveniently be reduced to a two-way data matrix of prominent interest, such as a genotype x location (GL) matrix for trials repeated over years.


    MEGA-ENVIRONMENT DELINEATION
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
The centerpiece of the GGE literature is GGE2 biplots augmented with polygons to show mega-environments, as illustrated by Fig. 1 in Yan et al. (2007). That review claimed that GGE biplots are superior to AMMI biplots for showing mega-environments, even in cases for which both methods happen to delineate the same mega-environments. This section lists 10 criticisms of AMMI in the order encountered in Yan et al. (2007), followed by our responses in a somewhat different order.

Criticism 1. The GGE2 biplot is more accurate for showing mega-environments because it always captures more G+GE than the AMMI1 biplot.
Criticism 2. The which-won-where patterns are not always easy to visualize in the AMMI1 biplot.
Criticism 3. Although Fig. 6.5 in Gauch (1992) proposed an AMMI2 biplot for showing mega-environments, its usefulness has not yet been demonstrated.
Criticism 4. The AMMI2 representation of mega-environments is better understood as a conclusion-presentation tool, rather than a pattern-discovery tool, because the winning genotypes are identified from a separate table of AMMI2 predicted values and subsequently are superimposed on the graph.
Criticism 5. The AMMI2 biplot is not capable of displaying which-won-where patterns because G and PC scores are not in the same units.
Criticism 6. The AMMI1 biplot lacks the most important property of useful biplots, the inner-product property, because its two axes are not in the same units.
Criticism 7. The AMMI2 biplot also lacks the inner-product property.
Criticism 8. The hypothesis in Gauch (1992) that universal winners would be located near the origin of the AMMI2 biplot is not dependable, especially since universal losers would also be located there.
Criticism 9. The shapes of mega-environment regions in an AMMI1 biplot are completely subjective because its axes are in different units.
Criticism 10. Unlike the GGE2 biplot augmented to show mega-environments, the AMMI1 counterpart also displays the environments E, which are irrelevant to cultivar and test-environment evaluations.


Figure 1
View larger version (13K):
[in this window]
[in a new window]

 
Figure 1. AMMI1 biplot for an Ontario wheat trial. The genotype and environment means are shown on the abscissa, with a vertical line at the grand mean of 4.186 Mg ha–1. The principal component (PC) 1 scores are shown on the ordinate, with a horizontal line at 0. This graph captures 93.4% of the yield variability.

 

Figure 6
View larger version (10K):
[in this window]
[in a new window]

 
Figure 6. A scatterplot of discriminating power and representativeness for those seven environments comprising a single mega-environment from an Ontario wheat trial. For each environment, discriminating power is measured as the standard deviation of the 18 genotypes in that environment and representativeness is measured as the correlation between genotype values in the environment and genotype means across all environments. The vertical line shows the average discriminating power of 0.723, and the horizontal line shows the average representativeness of 0.812.

 
Response to Criticism 1
The first part of this criticism, that more G+GE implies more accuracy, is sometimes true and sometimes false. Capturing more G+GE than AMMI1 does not automatically translate into more accuracy. Most pointedly, sometimes AMMI0 is the most predictively accurate member of the AMMI model family because the GE interactions are small and are buried in the noise. Also, sometimes GE is only marginally significant, in which case AMMI1 can be more accurate than AMMI0, whereas capturing even more GE than AMMI1 by means of either the GGE2 or AMMI2 model only decreases accuracy. Recall Ockham's hill, that overly simple models underfit real signal whereas overly complex models overfit spurious noise (Gauch, 2006b).

The second part of this criticism is true, that a GGE2 biplot always and automatically captures more G+GE than an AMMI1 biplot. This fact was clear in both review articles, Gauch (2006a) and Yan et al. (2007). However, it is only one of a set of three truths that belong together.

The second truth is that model diagnosis is essential for mega-environment delineations and graphs. For instance, consider the Ontario winter wheat (Triticum aestivum L.) data in Table 1 of Yan et al. (2007), which were also given in Table 4.4 in Yan and Kang (2002) with one more digit; we have used the latter version. The AMMI1 model recognizes two winners (identical to those of GGE2), AMMI2 recognizes three, AMMI3 recognizes four, and the higher models from AMMI4 to the full model AMMI8 (which equals the actual data in Table 1) recognize five or six, which implies anywhere from two to six mega-environments, depending on model diagnosis and choice. A similar story applies to the GGE model family for those data. Another example is presented in Fig. 5 of Gauch and Zobel (1997).


View this table:
[in this window]
[in a new window]

 
Table 1. Recovery of sums of squares for genotype (SSG) and sum of squares for genotype x environment (SSGE) effects by axes in various genotype main effects and genotype x environment (GGE) and additive main effects and multiplicative interaction (AMMI) biplots for a winter wheat yield trial with a subset of seven environments (from Yan et al., 2007, their Table 1 and Fig. 2). Although not indicated in this table, the AMMI2 mega-environment display captures 100% of the genotype effects in a manner that does not use or require an axis.

 

Figure 2
View larger version (11K):
[in this window]
[in a new window]

 
Figure 2. AMMI1 mega-environment display for an Ontario wheat trial. Environment means are shown on the abscissa and principal component (PC) 1 scores on the ordinate. There are two mega-environments, with genotype G18 winning in environments E5 and E7 and genotype G8 winning elsewhere.

 

Figure 5
View larger version (12K):
[in this window]
[in a new window]

 
Figure 5. A scatterplot of mean yield and instability for the 18 genotypes in an Ontario wheat trial. Mean yield is a genotype's average over the environments, including only those seven environments comprising a single mega-environment. Instability is measured as a genotype's contribution to the sum of squares for genotype-by-environment interaction. The vertical line shows the grand mean of 3.96 Mg ha–1, and the horizontal line shows the average instability of 0.523.

 
Consequently, mega-environment delineation and model accuracy are inexorably intertwined. Most pointedly, if a GGE2 biplot is used uncritically as an automatic default for delineating mega-environments, even though in a given case, model diagnosis would reveal that GE is buried in noise, then a growing region may be subdivided into several mega-environments when no subdivision is needed. That mistake increases effort and cost while it decreases accuracy and benefit. Conversely, if the interaction is too complex to be captured by only two axes, a GGE2 or AMMI2 biplot may identify too few mega-environments.

The third of three interrelated truths, already emphasized in Gauch (2006a), is that an AMMI2 mega-environment display always captures more G+GE than a GGE2 mega-environment display—indeed, it automatically captures both more G (100%) and more GE. So, in the fairly common case that AMMI2 is more accurate than AMMI0 and AMMI1 (or even in the still more common case that AMMI3 or a higher model is most accurate, but practical constraints favor sacrificing a little accuracy to gain the fewer mega-environments of the simpler AMMI2 model), the AMMI2 graph will be more accurate than the GGE2 graph.

Combining the first and third truths, the amount of G+GE captured always follows the rule that AMMI1 < GGE2 < AMMI2. For the Ontario wheat example in Yan et al. (2007), AMMI1 captures 75.8%, GGE2 captures 78.0%, and AMMI2 captures 86.7%. For another example, using values from Table 1 in Gauch (2006a), for the G+GE variability of a soybean [Glycine max (L.) Merr.] yield trial, AMMI1 captures 85.1%, GGE2 captures 88.6%, and AMMI2 captures 95.1%. For a third example, for the international bread wheat (Triticum aestivum L. em Thell.) trial in Crossa et al. (1991) with enormous GE interactions, these three figures are 35.3%, 44.4%, and 47.5%.

Given that GGE2 is flanked on both sides by AMMI models, the only case for which GGE2 is likely to be most predictively accurate is when Ockham's hill has a nearly flat peak around AMMI1 and AMMI2. Such cases are rather rare, but can occur, as in Fig. 4.6 in Gauch (1992, p. 143). And yet, in precisely such cases, the marginal increase in accuracy for GGE2 over the better of AMMI1 and AMMI2 would be expected to be quite small—often too small to have statistical significance, except for unusually large datasets.


Figure 4
View larger version (14K):
[in this window]
[in a new window]

 
Figure 4. An AMMI2 mega-environment display for an Ontario wheat trial. To avoid clutter, genotype winners are identified only for the three mega-environments that include one or more environments. In addition, G10 would have won for an environment located in the small triangular region at the top, G17 for the bottom left region, G5 for the bottom middle region, and G4 for a region too small to be shown. This graph was constructed with even singular value partitioning (SVP) and no axis rescaling (although other SVP and rescaling choices would leave mega-environment assignments invariant). Products of genotype and environment scores, summed for both principal components, approximate interactions and are in units of yield, namely Mg ha–1. This AMMI2 display incorporates 86.7% of the genotype + genotype x environment information, whereas its genotype main effects and genotype x environment interaction 2 (GGE2) counterpart incorporates only 78.0%. (PC, principal component.)

 
Hence, if capturing as much as possible of the signal in G+GE (and as little as possible of the noise) is to be the criterion for choosing a mega-environment display, then AMMI1 or AMMI2 will almost always surpass GGE2 in accuracy. The outflanked GGE2 can win only rarely and even then only marginally. Accordingly, we reject criticism 1, with its opposite conclusion favoring GGE2, because its faulty argument recognizes only one of three interrelated truths.

Response to Criticisms 2, 6, 9, and 10
Four criticisms question the meaningfulness of AMMI1 displays for showing mega-environments. A particular concern is that the two axes of AMMI1 biplots are in different units, such as yield (in kg ha–1 or whatever) for the main effects on the abscissa and the square root of yield for the interaction effects on the ordinate.

Criticism 2 claims that the which-won-where patterns are not always easy to visualize in the AMMI1 biplot. We could not see the point of this criticism. Figures 1–3GoGo present AMMI1 results.


Figure 3
View larger version (21K):
[in this window]
[in a new window]

 
Figure 3. Adaptive responses for Ontario wheat genotypes according to the AMMI1 model. Principal component (PC) 1 scores for the nine environments are shown on the abscissa and nominal yields for the 18 genotypes on the ordinate. The two genotypes, G8 and G18, that win over some range of PC1 scores are identified individually, whereas the responses of the losers are indicated by thin lines. Note that G18 wins in E5 and E7, whereas G8 wins in the other seven environments.

 
Figure 1 shows the AMMI1 biplot for the Ontario wheat example. The abscissa shows differences in main effects and the ordinate differences in interaction patterns. This biplot captures 93.4% of the yield variability. AMMI calculations were performed by the open source software MATMODEL Version 3.0 (Gauch, 2007) and graphs were rendered by SAS/GRAPH (SAS Institute, 1999). Provided that the genotype effects are large enough to dominate GGE's PC1, the abscissa of an AMMI1 and GGE2 biplot both capture main effects (exactly for AMMI1 and approximately for GGE2), and likewise, both ordinates capture GE interaction effects (exclusively for AMMI1 and mostly for GGE2). Consequently, the broad arrangements of markers in AMMI1 and GGE2 biplots are often similar, as in the present case. Usually PC1 from AMMI1 correlates highly with PC2 from GGE2.

Figure 2 shows the AMMI1 mega-environment display for the same example, obtained by replacing genotype markers with genotype winning regions. There are two mega-environments, identical to those delineated by GGE2 in this instance. The AMMI1 mega-environment geometry is quite simple, involving a single horizontal line at a PC1 score of 0.18158. For comparison, the corresponding GGE2 display in Fig. 1 of Yan et al. (2007) requires a five-sided polygon and five rays from the origin, for a total of 10 lines. Consequently, the opposite of criticism 2 obtains because the AMMI1 geometry is considerably simpler and hence easier to visualize.

Figure 3 shows nominal yields for the 18 wheat genotypes as a function of environment PC1 scores from AMMI1 analysis. The mega-environment boundaries in Fig. 2 can be understood by the responses in Fig. 3, particularly that the two winners are G8 and G18 and that their response lines cross at a PC1 score of 0.18158. Genotype G18 wins in environments E5 and E7, whereas G8, which has the highest overall mean, wins in the other seven environments. Genotypes with a flat response possess greatest stability and are widely adapted if they also possess high mean yield. The genotype with greatest stability is G15 (as readily identified in Fig. 1 as the entry with a PC1 score nearest to 0), shown in Fig. 3 by the thin line starting at 4.237 Mg ha–1 on the left and rising to 4.367. But G15 is so far from winning anywhere that no sacrifice of high performance for the sake of greater stability is warranted in this case. Figures based on AMMI1 and GGE2 are comparable, as both capture GE interaction essentially on one PC axis. But the AMMI1 graph shown in Fig. 3 is simpler and clearer than the GGE2 biplot for visualizing mega-environments, genotype adaptive responses, and similarities among test environments for GE effects. It is analogous to the venerable linear regressions of Fig. 2 in Finlay and Wilkinson (1963), except that environment PC1 scores substitute for environment means along the abscissa. However, AMMI1 always captures more GE than linear regression, in this case, 48.2% instead of only 11.4%. A variant of Fig. 3 is to show interactions rather than nominal yields, as in Fig. 3.10 of Gauch (1992, p. 95). Yet another variant would be to use GGE instead of AMMI, preferably using the perpendicular to the average environment coordinate (AEC) with SVP = 1 rather than any of GGE's original axes to capture as much GE interaction as is possible in GGE analysis. However, even this best of the GGE options captures less GE than does AMMI's PC1, so the AMMI display of nominal yields as in Fig. 3 is ordinarily preferable.

Simple models such as AMMI1 or GGE2 (in which the GE interaction can be taken into account essentially by one principal component) are frequently adequate when analyzing GL interaction in trials repeated in time (Annicchiarico, 1997). In addition, a preference for simple models and fewer mega-environments may arise from the tradeoff between the advantage of greater gains from specific adaptation and the disadvantage of less data and hence less accuracy within each mega-environment that derive from increasing the number of mega-environments (Atlin et al., 2000; Piepho and Möhring, 2005).

Criticism 6 objects that the AMMI1 biplot lacks the inner-product property. This is true. But this is also irrelevant as regards delineating mega-environments. At any rate, sometimes a purpose can be accomplished by various means. A major application of the inner-product property is to approximate the yield and ranking of each genotype for any chosen environment. But this same information is available from a tabular representation. For each environment, the genotypes can be ranked by their AMMI or GGE estimated yields. One can scan down the list of model expected yields much quicker than one can mentally construct the corresponding information from a biplot. Furthermore, the tabular presentation is equally suited to any member of the AMMI or GGE model family, whereas the GGE biplot presentation is restricted to GGE2, which usually is not the most predictively accurate member of the GGE family. Similarly, the commonly used AMMI biplots are restricted to the AMMI1 and AMMI2 models. Finally, the tabular presentation lends itself to useful summary statistics, such as the average yield advantage in each mega-environment for selecting parsimonious model winners rather than actual data winners, on the assumption that the estimated model is more accurate than its data (as demonstrated by cross-validation or other model diagnosis methods).

Yet another alternative is shown in Fig. 4 of Gauch and Zobel (1997). That figure shows environment means on the abscissa and interactions (also in units of yield, not the square root of yield) for each environment's genotype winner on the ordinate. Yield isolines form a simple herringbone pattern. This display shows at a glance how different main and interaction effects can combine to achieve a given yield level. Whereas the GGE2 biplot with inner-product interpretation provides a lot of detail, this AMMI-based figure provides what one might regard as an executive summary.

Criticism 9 objects that the shapes of mega-environment regions in AMMI1 biplots are completely subjective because this biplot's axes are in different units. This is false. Precisely because AMMI1 mega-environments are delineated by horizontal lines, the resulting rectangular shape for mega-environments is invariant even under axis transformations. The relative sizes of mega-environment regions could change under axis transformations (which potentially also change axis units), but that would not change the mega-environment assignment of any environment. Given the data, mega-environment boundaries in the AMMI1 display follow inexorably by mathematical equations. There is nothing subjective whatsoever about either the shape or location of mega-environment boundaries.

Criticism 10 objects that the AMMI1 mega-environment display also includes information on E main effects, which is irrelevant to cultivar and test-environment evaluations. Since an axis is used to give the needed main effects for G, that axis can also present E at no extra cost, so this criticism lacks force. More important, this criticism's logic seems backward. Precisely because the AMMI1 biplot provides G and E main effects, a single biplot serves both crop and soil scientists equally well, whereas comparable information in the GGE paradigm would require a GGE2 biplot for crop scientists and an EGE2 biplot for soil scientists. Given that most sizable agricultural projects involve interdisciplinary teams of crop and soil scientists, a single unified presentation for everyone is far preferable. Although AMMI has been used less frequently in soil sciences than in crop sciences, examples include association of AMMI parameters with soil and other environmental variables (Nachit et al., 1992), analysis of GE responses to soil conditions (Kondo et al., 2003), analysis of soil microbial communities (Thies, 2007), and selecting ideal test sites based on GE responses to the sand and silt contents of soils (Laurentin et al., 2007).

Sometimes the environments are location-year combinations. In such cases, providing information on G and E and GE allows researchers to see whether a test location varies over years in main effects or interaction effects or both or neither (as in Fig. 6.4 of Gauch 1992, p. 218). And by adding mega-environment boundaries (as in Fig. 3 in Gauch and Zobel 1997), researchers can determine whether each test location is predictive for a given mega-environment or else is frequently crossing mega-environment boundaries from year to year (analogous to Fig. 6.5 of Gauch 1992, p. 222).

Response to Criticisms 4, 5, and 8
Three criticisms question the meaningfulness of AMMI2 biplots for showing mega-environments. Beginning with criticism 4, Yan et al. (2007) describe a presumed method for augmenting an AMMI2 biplot with mega-environments. For each winning genotype, its group of environments is determined by consulting a table of predicted yields for the AMMI2 model; those groupings are then superimposed on the biplot. Accordingly, they regard an AMMI2 mega-environment graph as a conclusion-presentation tool rather than a pattern-discovery tool.

However, this presumed method would not work. For instance, again using their Ontario wheat example, the mega-environment with G18 as its winner includes two environments, E5 and E7. But mega-environment regions in AMMI2 graphs are polygons (as in GGE2 as well). Although two points can define a line, they cannot define a region containing any area.

Moving on to the actual methods used to delineate mega-environments in an AMMI2 biplot, a simple method is to cover the biplot with a grid of 70 by 70 or 100 by 100 or whatever evenly spaced points (representing hypothetical environments) and then to note the winning genotype in each pixel. That suffices to delineate mega-environments within visual accuracy. And if the exact locations of each vertex of a polygon are desired, the genotypes that meet at a vertex provide a system of simultaneous equations that can be solved easily to obtain the exact coordinates.

As previously explained in Gauch (1992, p. 222–230) and Gauch (2006a), these calculations involve not only the first and second PC scores that appear in the AMMI2 graph but also the genotype main effects that remarkably are incorporated without their requiring another axis. But because information beyond that presented directly in the AMMI2 biplot's two axes is used, it is fair to call this a display of mega-environments rather than a discovery. But this distinction seems rather immaterial. In the GGE2 world, either the GGE2 mega-environment graph or the GGE2 table of expected yields can be used independently to "discover" the mega-environments; therefore, neither source of mega-environment information has any inherent priority in terms of discovery.

Rather, the salient distinction is that by incorporating G information without needing an axis, AMMI2 biplots can capture more G+GE than GGE2 biplots. For instance, for the Ontario yield trial of Table 1 in Yan et al. (2007), the which-won-where patterns and mega-environments for AMMI2 are based on 100% of G (automatically) and 71.67% of GE, whereas those for GGE2 are based on 99.45% of G and 53.73% of GE.

Criticism 5 claims that the AMMI2 biplot is incapable of displaying which-won-where patterns because G and PC scores are in different units. This is manifestly false. As just explained, information on G is incorporated without using an axis. Both G and the products of genotype and environment PC scores (which is what enters into the calculations of expected values) are in the same units, namely the units of the data, such as yield.

Figure 4 shows the AMMI2 mega-environment graph for the Ontario wheat trial, which may be compared with the GGE2 graph in Fig. 1 of Yan et al. (2007). The two graphs have a similar geometry. Whereas AMMI2 has a set of irregular polygons covering the graph, GGE2 has a set of irregular polygons arranged like slices of a polygon-shaped pie. However, the AMMI2 display incorporates 86.7% of the G+GE information, whereas GGE2 incorporates only 78.0% (because AMMI2 has two components devoted to GE whereas GGE2 has only one component, PC2, that focuses GE). Genotype G8 wins by having the highest overall mean across environments, as indicated by its mega-environment containing the origin, whereas G6 wins in E1 and E5 and G18 wins in E7 by virtue of sizable positive interactions that more than compensate for these genotypes' smaller means. These two methods provide consistent indications on winning genotypes except for E5, where G6 wins for AMMI2 but G18 wins for GGE2. In the absence of information required for statistical testing of PC axes for this Ontario wheat example, we could not verify whether the additional GE effects taken into account by AMMI2 relative to GGE2 (or AMMI1) are dominated by signal or noise.

Criticism 8 claims that Gauch (1992) hypothesizes that universal winners would be located near the origin of the AMMI2 biplot but objects that this is unreliable since universal losers would also be located there. But no such hypothesis is to be found in the pages of Gauch (1992). To the contrary, the markers for genotypes in an AMMI2 biplot (not to be confused with a display of mega-environments, as in Fig. 4) convey no information about universal winners or losers. Precisely because an AMMI2 biplot presents information directly on GE but not G, universal losers (or winners) could appear anywhere and have no requirement to be located near the origin. By contrast, the AMMI1 graph presents information directly on both G and GE, so it can locate potential and universal winners, as shown in Fig. 7 of Gauch and Zobel (1997). (But note the correction that the thick line down the markers for 3165 to 1827 should follow the right side of those points rather than the left.) Also consider a graph of adaptive responses based on AMMI1 as in Fig. 3 (and in Fig. 2 of Gauch and Zobel, 1997).

Response to Criticism 7
Criticism 7 claims that the AMMI2 biplot lacks the inner-product property. That is false. Kempton (1984) first imported the inner-product property of biplots into the agricultural literature from their first description by Gabriel (1971). Kempton used an example of a winter wheat yield trial. He derived the inner-product formula in his text, showed its geometry in his Fig. 3, and gave a formal proof in his Appendix. Note from his Eq. [9] that the model he used to illustrate the inner-product property is the AMMI2 model. Kempton gave the values obtained by his equation the vague name residual yields, but from his definition (Kempton, 1984, p. 127), they are interactions. Accordingly, the "expected response" or "predicted response" to applying the inner-product formula to the AMMI2 biplot for the wheat trial in his Fig. 4 is an interaction, rather than a yield. Kempton was so focused on the GE interactions that his Table 1 presents these interactions rather than the actual yields.

Consequently, it is ironic that Yan et al. (2007) deny that the AMMI2 biplot has the inner-product property because it was precisely the AMMI2 biplot that was used to introduce this property in the agricultural literature. For over two decades, the literature has been clear that the AMMI2 biplot has the inner-product property.

Incidentally, Kempton (1984) included another example of a fungicide trial using the GGE2 biplot, which also has the inner-product property. In this case, these products approximate environment-centered yields, rather than either the actual yields or the interactions.

Continuing the early history of biplots, the very first biplot, Fig. 2 in Gabriel (1971), used neither AMMI2 nor GGE2. Gabriel applied noncentered PCA to a data matrix and then removed the first component because it captures mainly the simple row and column main effects of little interest to him, whereas he was interested in complex "differential" responses captured in components 2 and 3 (also see Jolliffe, 1986, p. 227–228). He explained that his residual matrix "corresponds to interaction residuals after fitting an additive model," although "corresponds" should not be misinterpreted as "equals." However, the model that would distinguish main and interaction effects exactly is, of course, AMMI. It is interesting that Gabriel focused on "differential" responses and noted their correspondence with interactions. Gabriel's approximate interactions were followed by Kempton's exact interactions.

AMMI2 biplots, which have the inner-product property, have a long history in the statistical literature because researchers frequently need to distinguish average or main effects from "differential" or interaction effects. For agricultural researchers, this corresponds to the fundamentally important distinction between broad and narrow adaptations, which have quite different implications for mega-environments.

Likewise, for ecological data, Digby and Kempton (1987, p. 12) gave several reasons why main effects are usually of less interest than interaction effects. Accordingly, ecologists often construct biplots with AMMI (also called doubly centered PCA). Digby and Kempton (1987, p. 12) and Jolliffe (1986, p. 214) elucidate an interesting relationship between AMMI and correspondence analysis (also called reciprocal averaging): AMMI applies SVD to the residuals from an additive model, whereas correspondence analysis analyzes residuals from a multiplicative model.

An AMMI2 biplot of the GE matrix of interactions provides an inner-product representation of interactions, a GGE2 biplot of the G+GE matrix of environment-centered yields provides an inner-product representation of environment-centered yields, a PCA2 biplot of the data minus grand mean matrix of corrected yields provides an inner-product representation of corrected yields, and a noncentered PCA2 biplot of the actual yields provides an inner-product representation of the actual yields. Which biplots are of greatest interest and utility depends on the research context.

As Yan et al. (2007) observed, the which-won-where view also works for SVP = 1. Indeed, any SV partitioning leaves mega-environment assignments invariant, but because focusing on environments has some advantages in this context, SVP = 2 was used for their Fig. 1.

A future development mentioned in Yan et al. (2007) is a sequential data subdivision method using GGE2 mega-environment displays, guided by formal statistical tests or imposed practical considerations, to produce data subsets that each comprise an individual mega-environment. Clearly, some such stopping rule or test is needed. For instance, their Fig. 1 subdivides an Ontario wheat trial into two mega-environments, with the larger having seven environments and the smaller having two. However, if a GGE2 biplot with the which-won-where view is constructed for this larger mega-environment, it splits again, with environment E1 separating from the others. Continuing this process leads to no further splits. Hence, depending on what a statistical test or stopping rule would indicate, this Ontario trial may have one, two, or three mega-environments. Which is it? Accordingly, the which-won-where view, as in their Fig. 1, is somewhat uninformative apart from a significance test. Alternatively, mega-environments delineated by a GGE2 biplot (or several sequential biplots) could be justified by considerations of the most predictively accurate member of the GGE model family, perhaps with slight sacrifice of accuracy to gain simplicity as required because of practical constraints requiring few mega-environments.

Response to Criticism 3
Finally, criticism 3 objects that the AMMI2 mega-environment display proposed in 1992 has not yet been shown to be useful. We reply that this neglect is unfortunate, given the above considerations in favor of AMMI2. Hopefully, this communication will encourage researchers to use AMMI2 for mega-environment delineation when the AMMI2 model is deemed predictively accurate. The AMMI2 mega-environment display has been implemented in at least two free software packages used by many breeding programs worldwide, MATMODEL (Gauch, 2007) and CropStat (IRRI, 2008, formerly called IRRISTAT).


    GENOTYPE EVALUATION
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
The principal GGE tool for genotype evaluation is a GGE2 biplot augmented with the AEC axis and its perpendicular (AEC{perp}) to separate G from GE, thereby providing the "mean vs. stability" view shown in Fig. 2 of Yan et al. (2007). By definition, the AEC axis passes through the biplot origin and the "average environment," which has coordinates that are the mean of environment PC1 scores and the mean of environment PC2 scores. Deeming that "genotype evaluation is meaningful only for a specific mega-environment," this tool is restricted to sets or subsets of environments comprising only one mega-environment. Such biplots use genotype-focused partitioning, SVP = 1.

Yan et al. (2007) made five claims regarding genotype evaluation:

Claim 1. "The AEC abscissa approximates the genotypes' contributions to G."
Claim 2. Accordingly, "the AEC ordinate must approximate the genotypes' contributions to GE, which is a measure of their stability or instability." That is, AEC and AEC{perp} separate G from GE.
Claim 3. Projections of genotype markers onto AEC show "the rank-two approximation of the genotype means."
Claim 4. "Unless G is too small to be meaningful, the ranking of the genotypes on the AEC abscissa is always perfectly or highly correlated with G."
Claim 5. Such GGE functionality as allowing genotypes to be evaluated by their mean performance and stability (as in their Fig. 2) has not been shown for any other yield-trial analysis, including AMMI.

Table 1 shows recovery of SS for G (SSG) and SS for GE (SSGE) for various GGE and AMMI biplots. The GGE2 original axes mix G and GE in both PC1 and PC2. The total SSG in the GGE2 biplot is 16.96108 or 99.82% of the dataset's total of 16.99157. And the total SSGE in the GGE2 biplot is 4.02898 or 42.80% of the dataset's total of 9.41432. As proven in generality in the Appendix and as shown for the Ontario wheat trial in Table 1, AEC captures all SSG in the GGE2 biplot, regardless of SVP. But for this particular dataset, AEC{perp} captures more SSGE with SVP = 1 than with SVP = 2, so the choice of SVP = 1 is preferable.

Hence, regarding claims 1 and 2, the AEC and AEC{perp} axes are only partially successful in separating G and GE. For SVP = 1 as used in their Fig. 2, AEC captures 100% of the SSG in the GGE2 biplot or 99.82% of the SSG in the dataset, although it is contaminated with 8.12% of the SSGE in the biplot or 3.48% of the SSGE in the dataset. And AEC{perp} captures 91.88% of the SSGE in the biplot or 39.32% of the SSGE in the dataset.

Regarding claim 3, projections of genotype markers onto AEC are rank-two approximations, but not of "genotype means" (over replications). The G+GE matrix contains the yields minus environment deviations and the grand mean, so these projections approximate the environment-centered yield for each genotype. Incidentally, an exception is a dataset with only three environments, which is rank two after environment centering, meaning that the projection yields an exact prediction.

Regarding claim 4, the AEC axis can be highly correlated with G and can have the same genotype rankings. But the AEC axis cannot possibly be "perfectly" correlated with G because the GGE2 biplot does not capture G completely. For their Fig. 2 with SVP = 1 and consequently AEC at 10.99°, Yan et al. (2007) stated that this correlation is 1.0, but in fact, it is 0.99910.

Regarding claim 5, the intended function of the AEC and AEC{perp} axes is to separate G from GE, thereby providing the "mean vs. stability" view of their Fig. 2. They deny that any analysis other than GGE provides such functionality. But consider the results for AMMI in Table 1 and Fig. 1. AMMI is the optimal method for separating G from GE. The abscissa of an AMMI1 biplot captures 100% of G. And among all SVD-based analyses including GGE, by the least-squares property of SVD applied to the GE matrix, the AMMI1 ordinate with its PC1 captures as much as possible of GE. The ANOVA part of AMMI can do what the PCA part of GGE cannot possibly do: separate G from GE.

Admittedly, the GGE2 biplot does capture more GE than the AMMI1 biplot, namely, 4.02898 compared with 3.78834 for this Ontario wheat trial. This is possible because the GGE2 biplot has two axes capturing some GE, whereas the AMMI1 biplot has only one. But this isolated fact could easily be misinterpreted. Note that what matters for GGE2 in the present context of separating G from GE is not the total amount of GE but rather the amounts in AEC and AEC{perp} separately because GE in AEC is undesirable whereas GE in AEC{perp} is desirable. For the GGE2 biplot using SVP = 1, as in Fig. 2 of Yan et al. (2007), AEC{perp} captures 3.70190, which is somewhat less than PC1 for AMMI1 with 3.78834. This is the relevant comparison. In conclusion, compared with AMMI1 axes, AEC recovers less G, and AEC{perp} recovers less GE, meaning that GGE2 is doubly unsuccessful at separating G from GE. Incidentally, were SVP = 2 used instead, then AEC{perp} would capture considerably less, only 3.26753.

The AMMI1 biplot in Fig. 1 has additional advantages over the GGE2 biplot for showing mean vs. stability. It is simpler to construct and to interpret because its axes are used directly, rather than needing to be rotated. Also, AMMI separates G from GE perfectly regardless of how simple or complex a dataset may be, whereas for GGE the assumption of a single mega-environment is critical because otherwise a large GE relative to G could drive a large portion of G into the third and higher components that a GGE2 biplot misses. Furthermore, the AMMI1 biplot provides all parameters needed to reconstruct this model's estimates of yields, whereas the GGE2 biplot can access only environment-centered yields.

Having argued that an AMMI1 biplot is superior to a GGE2 augmented biplot with the AEC axis for displaying each genotype's mean and stability, it must be emphasized that other methods may also merit consideration when AMMI2 or more complex AMMI models are needed to account for GE effects deemed relevant by model validation or statistical tests. One or more stability statistics could simply be tabulated along with mean values of genotypes, allowing researchers to scan exact values of these estimated parameters. For instance, for the Ontario wheat example in Fig. 2 of Yan et al. (2007), AEC{perp} in the GGE2 biplot captures only 39.32% of GE; similarly, PC1 in the AMMI1 biplot captures only 40.24%, whereas a tabulated stability measure can access 100% of GE for many such measures, including ecovalence (the SS contribution to GE of each genotype; Wricke, 1962).

Alternatively, a scatterplot could show for each genotype its mean on the abscissa and one desired stability measure on the ordinate. Scatterplots "are not only easy to produce, but they also have the merit of being straightforward to interpret, requiring very little, if any, formal training" (Gower and Hand, 1996, p. 1).

For example, Fig. 5 shows the mean and ecovalence for the 18 wheat genotypes in the seven Ontario locations comprising a single mega-environment in Fig. 2 of Yan et al. (2007). Graphing these two values directly in a scatterplot has advantages over the mean vs. stability view of a GGE2 biplot. Regarding the mean, the scatterplot gives its values for each genotype directly in units of Mg ha–1, while projections onto the tilted AEC axis in the GGE2 biplot involve PC scores with no direct relationship to yield. Regarding instability, the scatterplot gives the contribution to SSGE for each genotype directly, in units of yield squared and with reference to all GE effects. By contrast, projections onto AEC{perp} only approximate those contributions (ecovalences), perhaps poorly given that AEC{perp} captures only 39.32% of SSGE. In the GGE2 biplot, for instance, the approximated GE contribution for genotype G13 appears to be much smaller than for G17, about a third as large. But from the scatterplot, the fact emerges that genotype G13 makes a larger contribution than G17, actually the largest of all. The reason that the GGE2 biplot seriously underestimates the contribution of G13 is that this genotype has an unusually large score on PC3, which the GGE2 biplot misses.

Although a small dataset is convenient for illustrating statistical techniques and options, the sort of information sought from Fig. 5 here or the comparable Fig. 2 in Yan et al. (2007) requires a larger dataset. The stability measures considered here involve variances, which are second-order statistics. As a rule of thumb, they require at least 20 observations for acceptable accuracy, such as 10 locations for 2 yr or 7 locations for 3 yr. For a simple variance component, such as the environmental variance, which has been used as a stability measure, to be estimated with a coefficient of variation of 20%, 50 environments are required (Piepho, 1998b). Differences in stability should be assessed by significance tests (Piepho, 1996).

More research is needed to compare Fig. 1 and 5 for displaying mean vs. stability. Both cleanly separate G and GE and both capture 100% of G. Although the scatterplot in Fig. 5 has the advantage of capturing 100% of GE, the graph in Fig. 1 has two features that may outweigh that advantage. First, Fig. 5 shows only the relative amounts of GE, whereas Fig. 1 shows the inherent nature of an interaction as a contrast between opposite patterns of differential responses—as well as showing the corresponding interaction patterns for genotypes too. Second, by filtering out noise in the discarded late components and by focusing on the single largest interaction pattern, the AMMI1 biplot in Fig. 1 may be preferable. Further research may even show that accuracy gain from a parsimonious AMMI1 model often allows the parameters in Fig. 1 to be estimated with adequate accuracy and reproducibility for experiments with less data than the 20 environments needed for reliable results in Fig. 5. Agricultural researchers often have an interest in stability (or dependability) despite having experiments with fewer than 20 environments. Consequently, if PC1 scores from AMMI show consistent reproducibility for, say, only 10 or 12 environments, that statistical efficiency could be advantageous.

Yet another possibility to consider for genotype evaluation is combining mean yield and stability into a single parameter of yield reliability (Eskridge, 1990). Also, Annicchiarico (2002) has proposed a simple although approximate method for incorporating temporal stability (assessed from repetition over years) into AMMI-modeled nominal yield responses to locations, thereby modeling yield reliability as the lowest nominal yield of genotypes expected at each site for a given probability of an unfavorable cropping year.


    TEST-ENVIRONMENT EVALUATION
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
The principal GGE tool for test-environment evaluation is a GGE2 biplot augmented with the AEC axis and using environment-focused partitioning SVP = 2 to provide the "discriminating power vs. representativeness" view shown in Fig. 3 of Yan et al. (2007). They state that the "purpose of test-environment evaluation is to identify test environments that effectively identify superior genotypes for a mega-environment" (Yan et al., 2007, p. 647). Hence, presumably, use of this biplot view is limited to datasets or subsets comprising only one mega-environment, thereby ensuring that PC1 and AEC will be dominated by genotype main effects.

Incidentally, the legend to Yan et al.'s (2007) Fig. 3 states that "genotype-focused singular value partitioning" was used, but plainly that is a mistake since numerous other indications are given that environment-focused partitioning was used. Indeed, SVP = 2 is necessary for this figure's functionality (Digby and Kempton, 1987, p. 63–67). As proven in the Appendix, SVP = 2 uniquely allows SSG and SSGE to be identified for an axis oriented in any direction; SVP = 1 has AEC rotated counterclockwise from the PC1 axis by 10.99° and SVP = 2 has 4.68°. Incidentally, for SVP = 2, the maximum SSG occurs at the AEC of 4.68°, but the maximum SSGE does not occur at the AEC{perp} of 94.68° but rather near 116°. Consequently, as shown in the Appendix, it is impossible to rotate the axes to maximize both SSG in AEC and SSGE in AEC{perp}.

AMMI1 and AMMI2 biplots may also be considered for test-environment evaluation. When test locations have been used for several years, AMMI is ideal for discerning different patterns of year-to-year variation and for relating the biplot region occupied by a given location to the mega-environment boundaries at which the winning genotype changes (Gauch, 1992, p. 217–230).

Figure 6 shows a scatterplot for discriminating power and representativeness, which presents more simply and directly the analogous information in Fig. 3 of Yan et al. (2007). The GGE2 biplot feature used for the "discriminating power" of each environment is a vector length that is proportional to "the standard deviation of cultivar means in the environment." And the feature used for the "representativeness" of each environment is the cosine of an angle between an environment vector and the AEC that approximates "the correlation coefficient between the genotype values in that environment and the genotype means across the environments" (Yan et al., 2007). But if these standard deviations and correlation coefficients are of agricultural interest, these simple quantities can be computed directly from the data and then displayed in a scatterplot. There is no need to perform multivariate analysis, rotate and rescale axes, and visualize lengths and cosines only to get approximate values instead of exact ones.

Although all of the above methods for test-environment evaluation may be useful or complementary, they seem overly complex and suboptimal. Selection theory proves that just one site characteristic matters for identifying optimal selection sites. The optimal site maximizes the phenotypic correlation between entry yields on the site and entry yields over the target environments (as represented by the test sites for a given mega-environment) because the phenotypic correlation includes the genetic correlation and the broad-sense heritability of the sites (Cooper et al., 1996). An example of optimal site selection in the context of a specific-adaptation strategy is given in Annicchiarico et al. (2005). AMMI analysis was used in combination with cluster analysis to identify two mega-environments for breeding, while phenotypic correlation was used to identify selection locations in each mega-environment.

Finally, researchers may want to consider artificial environments. Analyzing G and GE separately using AMMI for alfalfa (Medicago sativa L.) identified two major environmental factors associated with GE interactions across test sites (Annicchiarico, 1992). Subsequently, adaptive responses could be reproduced by means of only a few artificial environments established at a single site and reproducing different mega-environments by managing the levels of the two environmental factors (Annicchiarico and Piano, 2005). This approach allowed breeding for a few different subregions at a much lower cost than the usual strategy requiring more test sites (also see Annicchiarico, 2007a,b).


    ANALYZING GENOTYPE AND GENOTYPE x ENVIRONMENT JOINTLY OR SEPARATELY
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
The most fundamental disagreement between the AMMI and GGE paradigms concerns the relative advantages of analyzing both G and GE jointly in GGE analysis, or else analyzing both G and GE separately in AMMI analysis. Accordingly, this choice merits especially careful attention.

According to Yan et al. (2007), G and GE are interchangeable and their presumed separation in AMMI is based on merely a mathematical distinction lacking biological interpretability and agricultural meaningfulness. In fact, the distinctions between G, E, and GE in ANOVA have both mathematical validity and agricultural relevance, whereas the presumed interchangeability of G and GE renders the GGE position self-refuting. To review and critique the argument in Yan et al. (2007) in favor of GGE, it is helpful to organize their material in the format of a formal argument having four premises and two conclusions.

Premise 1. G and GE can be interpreted as wide and specific adaptations, respectively, only within the confines of a particular experiment's set of cultivars and set of environments.
Premise 2. GE becomes G if the scope of the environments is narrowed, whereas G becomes GE when the scope of the environments is widened, so there is no clear biological boundary between G and GE and hence, they are interchangeable.
Premise 3. Furthermore, the only possible basis for a clear biological distinction between G and GE would be that G and GE are controlled by distinct genes or genetic interactions. But quantitative trait locus (QTL) studies and analyses of adaptation show that such is not the case, so again G and GE are interchangeable.
Conclusion 1. Recognition of the interchangeability between G and GE is the sole justification for mega-environments as delineated by GGE analysis, which intentionally combines G and GE.
Premise 4. The distinction between G and GE, having no biological or agricultural meaning, is merely a mathematical distinction in the ANOVA.
Conclusion 2. Recognition that separating G and GE is based on an irrelevant mathematical distinction, rather than a meaningful biological or agricultural distinction, invalidates the case for AMMI at its very theoretical foundations.

This argument may appear to be strong and compelling. But consider the above six elements, one by one.

Critique of Premise 1
Granted, a different experiment with different cultivars and different environments can reach different results. If ever there was an automatic, guaranteed truism, this is it.

But the possibility of different experiments reaching different results in general and the actuality of results being unrepeatable in particular instances constitute two different matters. After all, the story of statistics is the story of using sizable and representative samples to make reasonably reliable inferences to a specified and larger population of inference, such as a dozen experimental locations in Iowa to make a crop recommendation for that state. Hence, premise 1 is overstated.

The valid content in this premise, even if trivial, is that yield-trial research is an experimental science with results that depend on the data. But the invalid implication from this premise is that somehow this dependency of results on data counts against AMMI solely. As the numerous citations from the Gauch (2006a) and Yan et al. (2007) reviews already documented, both G and GE effects—that is, both wide and specific adaptations—found in one experiment are routinely confirmed in additional experiments. Despite some failures, agricultural research is replete with repeatable results. In addition, nonrepeatable GL interaction revealed by repetition over years can be taken into account and used as the error term in selecting the AMMI model, thereby modeling only repeatable GL effects (Annicchiarico, 1997).

Critique of Premise 2
The language in premise 2, that GE "becomes" G (or the reverse), is vague and confusing. Instead, what should be stated is simply that in general similar environments induce small GE interactions whereas diverse environments induce large GE interactions (and likewise for similar and diverse genotypes). The commonplace observation that GE interactions are sometimes small and sometimes large does not in the least imply that G and GE are "interchangeable."

Critique of Premise 3
Yan et al. (2007) are quite correct in noting that major QTLs "often" affect both G and GE. But it is equally true that major QTLs often cause only GE, as shown by the results in their citations (e.g., Romagosa et al., 1996) and other articles (e.g., Romagosa et al., 1999; Ribaut et al., 2007). Cho et al. (2007), for example, detected 29 QTLs for main effects, 13 QTLs for GE effects, and 6 QTLs for both main and GE effects (ignoring several other QTLs detected with only minor or marginal statistical significance) in rice (Oryza sativa L.). And conventional breeding, with its longer history and more extensive experimentation, decisively reinforces the findings from molecular breeding. Specific phenological and physiological traits routinely cause an inverse genetic correlation between yield potential and adaptation to drought tolerance or other stresses. Hence, within reasonably large or diverse target regions, such traits (or combinations of traits) induce positive interactions in a particular kind of environment but negative interactions in other environments. Consequently, they contribute largely or even mostly to GE rather than to G. For instance, see Ludlow and Muchow (1990) and Wright and Rachaputi (2004) regarding drought tolerance and Worku et al. (2007) regarding nitrogen response. Ortiz et al. (2001) and Emebiri and Moody (2006) found high heritability for GE interaction effects captured by AMMI's PC1 scores.

Yan et al. (2007) advocated the possibly strong correlation (in absolute value) between genotypes' mean yields and AMMI PC1 scores as a further indication of common genetic control over G and GE effects, citing Ebdon and Gauch's (2002a) study of turfgrass quality as an example of that correlation. Studies on grain yield of major crops have shown this correlation in the presence of wide variation in site mean yield because of the contrast between high- and low-yielding sites for GE effects and the positive relationship of genetic variance with mean yield of sites. This implies that genotypes with large positive interactions with high-yielding sites also possess high mean yields (as in Annicchiarico et al., 2006). This scale effect of heterogeneity of genotypic variance among environments may account for most of the GE interaction variance, may produce noncrossover interactions, and may be removed by a suitable data transformation (Cooper et al., 1996; Annicchiarico, 2002, p. 51–54). Thus, the relationship of practical relevance to crop scientists, namely, that between G and crossover GE effects, cannot be revealed simply by correlations between mean yield and GE interaction parameters of genotypes. On the whole, there is little evidence from QTL studies, physiological information, and analyses of adaptation for common genetic control of G and relevant GE effects.

Critique of Conclusion 1
Indeed, an "interchangeability" between G and GE would be the best justification, even if not the sole justification, for GGE analysis. But the premise that G and GE are interchangeable is false, so this justification fails.

Critique of Premise 4
Genotype and GE effects are defined and distinguished by a mathematical conceptualization of yield trials, namely, ANOVA, as invented by Sir Ronald Fisher nearly a century ago. Admittedly, G and GE are not "things" in the real world, unlike the cultivars and environments that are physical things. The relevant issue here, however, is not whether G and GE are concepts or things but whether they are useful concepts or useless concepts.

To clarify the issue, consider an equivalent example. Speed or velocity is also a mathematical construct, namely, the first derivative of distance with respect to time (acceleration and shock are the second and third derivatives). There is no such "thing" as motion or velocity—rather, what are real are just objects in different places at different times. So, is velocity (or acceleration or shock) a useless concept, just because it is a mathematical construct involving differential calculus?

Critique of Conclusion 2
The persistent claim in the GGE literature that G and GE are indistinct or interchangeable is offered as a decisive criticism of AMMI. However, on two counts, when followed to its logical conclusion, this claim makes the GGE literature self-refuting.

First, given Eq. [4] for GGE or Eq. [5] for GGE2 more specifically (or Eq. [2] in Gauch 2006a or Eq. [1] in Yan et al., 2007), the very first step in GGE analysis is removing E. This step is necessary because the GE data matrix from a yield trial contains G+E+GE; so, to obtain the G+GE portion for GGE analysis, E must be removed. But removing E and removing G are entirely symmetric operations.

Consequently, the GGE literature's verdict that G is inseparable from (or interchangeable with) GE must apply equally to E being inseparable from GE, which in turn applies equally to E being inseparable from G+GE. And bear in mind that the GGE literature takes inseparability to mean a lack of biological and agricultural meaningfulness. The inexorable implication follows that GGE analysis begins with a meaningless calculation, which is self-refuting for the GGE position.

Gauch (2006a) already expressed this criticism. Again in other and fewer words, to question the meaningfulness of the distinction between G and GE is to question ANOVA, which the GGE literature needs to distinguish and separate E from G+GE. Readers of both reviews will notice that Yan et al. (2007) did not respond to this criticism in their review.

Second, although the boundaries between mega-environments depend on both G and GE, as everyone agrees, the existence of mega-environments depends on GE alone. If there were no GE interactions, then the rankings for genotypes tested in one environment would automatically apply to any other environment; thus, a new genotype would need to be tested just once against the current leader. The separation of GE from G and E should therefore be regarded as a relevant mathematical distinction because of the enormous agricultural significance and precise biological interpretation of GE as the sole cause of the existence of mega-environments. Accordingly, a GGE literature that persisted in claiming that G and GE are indistinct and interchangeable would be a literature that could not explain the existence of mega-environments. But this is a high price to pay because handling mega-environments is the centerpiece of Yan et al. (2007), as in their Fig. 1. Likewise, their claim that the AEC view of the biplot in their Fig. 2 and 3 "does reseparate G from GE whenever G is sizable" necessitates that G and GE be distinct and meaningful portions of the overall variation. Otherwise, no meaning could be given to their "mean vs. stability" or "discriminating power vs. representativeness" view of a GGE biplot, which again is a high price to pay. More generally, "G" and "GE" separately, as contrasted with "G+GE" jointly, appear literally dozens of times in Yan et al. (2007). Consequently, one can hardly imagine how a person who really thought that G and GE are interchangeable could manage to comprehend that paper.

There is only one way for the GGE literature to preserve (i) the validity of its first step of removing E from G+E+GE to obtain the necessary G+GE portion of the total variance and (ii) an explanation for the existence of mega-environments, necessarily in terms of GE alone. The GGE literature must retract the error of claiming that G and GE are inseparable and interchangeable, and it must reinstate the mathematical, biological, and agricultural meaningfulness of the distinctions in ANOVA between G, E, and GE.


    MODEL DIAGNOSIS AND ACCURACY GAIN
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
The review article by Gauch (2006a) emphasized that AMMI and GGE (and other variants of PCA) are essentially equal in their ability to gain accuracy by partitioning a parsimonious and signal-rich model from a discarded and noise-rich residual. Accordingly, there would seem to be no need for any further discussion of the relative merits of AMMI and GGE for gaining accuracy. However, the review by Yan et al. (2007) maintained a huge discrepancy between the AMMI and GGE literatures in their perspective on, and implementation of, opportunities to gain accuracy. So, despite no difference in theory and potential, there is a marked difference in practice that merits discussion. The position on model diagnosis and accuracy gain in the GGE literature, as reviewed by Yan et al. (2007), has three principal claims:

Claim 1. Accuracy gain should not be overstated. Researchers usually recommend a set of top cultivars, not just one cultivar, to the growers in a given region, so the exact rankings among these nearly equal cultivars are not important. Indeed, in practice it suffices to classify genotypes into just a few coarse categories, such as excellent, acceptable, and unacceptable. Also, breeders usually select for multiple traits, which reduces the relevance of great accuracy for any individual trait, including yield.
Claim 2. More pointedly, there is a fundamental difference between truly predicting future performance and merely "predicting" past performance. The latter, which has been prominent in the AMMI literature, uses data splitting or cross validation in which part of the data are used to assess the accuracy of AMMI models based on the remaining data from the same experiment. For real prediction from one experiment to other experiments, three specific conditions (discussed below) must be met, and all three are untenable in actual agricultural research.
Claim 3. Model diagnosis is useful to avoid underfitting or overfitting of mega-environments. Whereas claims 1 and 2 reiterate the ongoing position of the GGE literature, claim 3 introduces new research currently in progress.

Critique of Claim 1
In fact, accuracy matters. Gauch (2006a,b) gives many reasons why accuracy matters for both researchers and growers, so those reasons are not repeated here.

Classifying genotypes into just three categories—such as, good, medium, and poor—may suffice for the first of several stages of selection. Nevertheless, this seemingly modest task may be harder than one might suspect. Assume, for example, that numerous genotypes are to be screened with the objective of keeping the top 10 or 20%, but with only a single location and with little or no replication, the coefficient of variation is fairly large, for example, 15% or more. That noise level will cause many truly superior genotypes to be discarded summarily, as well as many truly inferior ones to be advanced, only to be discarded eventually after conducting more extensive and expensive tests (Gauch, 2006a). Thus, even coarse screening benefits from accuracy. On the one hand, given an early stage of selection without multiple environments, AMMI and GGE analyses are inapplicable, so a parsimonious model will not be a resource for gaining accuracy. On the other hand, were AMMI or GGE modeling applied to later stages with multiple environments for accuracy gain, that efficiency gain could liberate resources for improving the early stages of selection by means of more replication or other refinements (Gauch and Zobel, 1996).

A major focus of the GGE literature is delineating mega-environments by identifying the winning genotype in each environment, which contrasts with the objective advocated here of targeting several genotypes in each site. Indeed, sometimes the objective is to recommend a single genotype. On the other hand, predictively accurate yield estimates can be used to define mega-environments on the basis of more than one high-yielding genotype (Annicchiarico et al., 2006).

Furthermore, Yan et al. (2007) offered the premise that breeders often optimize several traits simultaneously in support of the conclusion that advantages from accuracy gain should not be overstated, but this logic seems backward. The more plausible conclusion regarding this challenging selection task is that using AMMI or GGE to gain accuracy for all of the traits would be enormously helpful.

Critique of Claim 2
Yan et al. (2007) objected that claims of AMMI accuracy gain depend on three conditions that are all implausible in actual agricultural research. But these conditions are overstated. They are examined here, starting with the second condition.

Their condition 2 requires that the most accurate member of the AMMI family must be used for recommendations, rather than substituting a simpler model for the sake of obtaining a smaller roster of winners that suits practical constraints. They observe that this was done in Ebdon and Gauch (2002b) and argue that this substitution "renders the model diagnosis completely irrelevant" (Yan et al., 2007, p. 651).

Recall the relationship between accuracy and parsimony, which has been well understood in theory and repeatedly demonstrated in practice. Although SVD-based analyses had been applied to yield trials for elucidating patterns at least as early as Fisher and Mackenzie (1923), the first application for the purpose of gaining accuracy was apparently Gauch (1988). Figure 1 in Gauch (1988) depicts the selective recovery of signal in early model components and the selective recovery of noise in late model components, such that overly simple models underfit real signal and overly complex models overfit spurious noise, whereas an intermediate range of relatively parsimonious models is more accurate than the data, that is, the full model. Figure 2 in Gauch (1988) gave the example of a soybean yield trial, with AMMI1 to AMMI13 more accurate than the data (or full model, AMMI14) and AMMI0 less accurate. Among the 13 models that gained accuracy, AMMI1 achieved the highest accuracy gain. Four years later, MacKay (1992) gave this accuracy response, which occurs in countless contexts across the sciences, a deep theoretical understanding and an apt name, Ockham's hill. Subsequently, Gauch (1993, 2002, 2006b) presented numerous examples of Ockham's hill. All of these examples follow the pattern of the Gauch (1988) example, that several members of the AMMI family are more accurate than the data, not just one member. Likewise, Table 1 in Ebdon and Gauch (2002b) showed that AMMI2 to AMMI7 are more accurate than the Kentucky bluegrass (Poa pratensis L.) data, with AMMI7 most accurate, whereas AMMI0 to AMMI7 are more accurate than the perennial ryegrass (Lolium perenne L.) data, with AMMI2 most accurate.

Of particular interest are the rather common instances in which Ockham's hill has a broad peak, in which case a slight decrease in accuracy can provide the tradeoff of a substantial increase in parsimony. And in multi-environment trials, greater parsimony means fewer mega-environments that are more manageable given various practical constraints, as Fig. 5 of Gauch and Zobel (1997) shows.

Hence, the logic in Yan et al.'s (2007) condition 2 seems backward. A switch from the most predictively accurate AMMI model to a simpler one accommodating practical constraints does not render model diagnosis "completely irrelevant," but rather, a switch is particularly well justified precisely when model diagnosis has shown that the simpler AMMI model also gains accuracy relative to the actual data, perhaps even with little sacrifice relative to the very best model. Also, note that Ebdon and Gauch (2006b) did use the higher-order AMMI models for estimating and ranking yields in their Fig. 1, whereas for the different research purpose of delineating mega-environments and displaying adaptive responses, they used the simpler AMMI1 model in their Fig. 2 to accommodate practical constraints. When a complex AMMI model provides a sizeable advantage over a simpler one in terms of predictive accuracy, condition 2 can easily be satisfied by targeting cultivars on the basis of tabulated expected yields for this model.

In much of the AMMI literature, model diagnosis has involved the error mean square, either directly (Gauch, 1992, p. 147) or indirectly by means of cross validation (p. 134–146). But when the research purpose is mega-environment delineation for trials repeated over years, the units to be grouped into a mega-environment are the locations rather than the environments (location-year combinations), so the genotype x location x year interaction (that is, the nonrepeatable GL interaction) is the relevant error term (Annicchiarico, 1997). In the context of trials repeated over years, using that error term improves the prediction of future responses and tends to diagnose simpler AMMI models, thereby reducing the amount of further adjustment required because of practical constraints.

Returning to Yan et al.'s (2007) condition 1, they insist that the accuracy gain from the best model is irrelevant in practice unless it leads to different cultivar recommendations than those indicated by the original data. This is a partial truth requiring some clarification. As explained above, accuracy gain may result from the most accurate member of a model family, but alternatively, a slight sacrifice in accuracy may be a worthwhile tradeoff to simultaneously achieve a small and workable number of mega-environments. Given that clarification, a parsimonious model must indeed make some different recommendations from the actual data to matter, which needs to involve some environments though not necessarily all. But far from being problematic, in practice this condition is met routinely.

For example, Table 1 in Yan et al. (2007) involves 18 genotypes, of which five are winners in one or more environments. But five mega-environments for Ontario winter wheat are decidedly excessive and unwieldy. Hence, there is merit in their parsimonious GGE2 model recognizing just two winners and hence two mega-environments—recall that Gauch (2006a) duplicated that result with the AMMI1 model.

Finally, Yan et al.'s (2007) condition 3 insists that future performances must be exactly the same as those indicated by the current data. And the authors argue that this condition is almost always false because of GE interactions and the fundamental difference between really predicting future performance and merely "predicting" past performance.

In reply, past and future performances need not be exactly the same, so condition 3 is excessive. Rather, it suffices for future performances to be substantially correlated with past performances. This adequate condition is met when past experiments guide growers' future choices within the same mega-environment. Indeed, the big payoff for delineating mega-environments successfully is that it allows past experimental results to be applied appropriately to future farming decisions. Only if a statistical method fails to delineate sensible mega-environments would it follow that past performance cannot guide future decisions.

That predicting future performance is harder than estimating past performance is a very good reason for doing more than fitting a parsimonious AMMI or GGE model. It is also a very bad reason for doing less.

Crossa et al. (1991) provided a dramatic example of the benefit of accuracy gain from AMMI analysis, specifically in the context of stratifying genotypes into three classes: top, middle, and bottom. They studied an international bread wheat trial with 18 genotypes tested in 25 locations. Remarkably, although these locations across several continents were extremely diverse, the quite parsimonious AMMI1 model was most predictively accurate, and it identified merely two mega-environments, differentiated by the degree of terminal heat stress. Correspondingly, the genotypes were placed in three groups having early, medium, and late maturity; clearly, the early maturity group is favored in locations with severe terminal heat stress. Their Fig. 2 shows that for three genotypes in the medium maturity group having small GE interactions, the "AMMI1 estimation had a profound effect, producing sharper, stratified ranking patterns" (Crossa et al., 1991). The AMMI1 yield estimates, which discarded the higher components containing mostly noise, gave each of these genotypes much more consistent rankings than did the noisy raw data, so that each genotype could be placed in the top, middle, or bottom group with much greater confidence. Turning to other genotypes with early or late maturity, which generated large GE interactions related to terminal heat stress, their opposite performances in the two mega-environments was very clear using AMMI1 adjusted yield estimates.

For another example, J. Scott Ebdon of the University of Massachusetts, Amherst, and Gauch have obtained preliminary results from a multiyear experiment to compare the predictive accuracy of AMMI estimates and actual data for the National Turfgrass Evaluation Program. At each of six locations, using 3-yr average quality ratings for the 1997 to 1999 Kentucky bluegrass tests, five winning genotypes were selected based on the actual data and another five winners based on AMMI estimates (with the occasional exception that a genotype appearing in both lists was bypassed). These 10 genotypes (in each location) were established in fall 2003. Quality data were subsequently collected in 2005 and 2006 and then averaged. The main result was that AMMI selections from the 1997 to 1999 data were five times as successful as the raw-data selections in recommending those genotypes that performed best (ranks 1 and 2) in the future, 2005 to 2006. Likewise, the raw-data selections were twice as likely as AMMI to recommend genotypes that performed worst (ranks 9 and 10). Hence, AMMI analysis increased predictive accuracy substantially (Ebdon and Gauch, unpublished data).

For a third example, Annicchiarico et al. (2006) found repeatable GL interactions over years for durum wheat (Triticum durum Desf.) in Algeria and hence, consistent mega-environments with substantially predictable interactions. Variety recommendations were based on 2 yr of data, using both the raw averages and the AMMI1 estimates. Both sets of recommendations were then compared using a third, independent test year. The yield gain across Algeria relative to the currently grown cultivars obtained by AMMI1 modeling was 10.3% compared with 6.2% for the full model (the observed 2-yr data). Thus, AMMI1 analysis provided an advantage of (10.3 – 6.2)/6.2 or 66% in yield gain at the very modest cost of the data analysis as compared to the high cost of multi-environment testing. Therefore, using a parsimonious model to gain accuracy was a highly cost-effective means for increasing efficiency and accelerating progress. Also, AMMI1 implied simpler recommendations with just 3 different winners and hence just 3 mega-environments, whereas the raw data indicated 15 winners and mega-environments. A more complex analysis, factorial regression (van Eeuwijk et al., 1996), which requires additional environmental data, achieved a slightly greater yield gain of 11.8%. Annicchiarico (2007b) also compared selection gains in breeding for broad and narrow adaptation using artificial environments that reproduced three mega-environments defined by AMMI and cluster analysis for alfalfa in northern Italy. The adoption of distinct genetic bases for the two most-contrasting mega-environments allowed for more than doubling the selection efficiency over the three mega-environments. AMMI analysis allowed identification of specific crop traits, germplasm pools, and testing conditions that together defined a specific-adaptation breeding strategy (Annicchiarico and Piano, 2005; Annicchiarico, 2007a). Repeatable interactions and consistent mega-environments are the basis for one experiment having predictive relevance for other experiments under similar conditions.

Empirical results thus confirm what statistical theory would suggest, that increasing accuracy for a given experiment increases predictive success for reasonably similar environments. That said, clearly much more could and should be done, including the following four opportunities. First, the AMMI literature has so far emphasized the model family comprised of truncated models—AMMI1, AMMI2, and so on—and the resulting Ockham's hill. Particularly because AMMI1 and AMMI2 can also be used for informative biplots, these models are quite useful. Nevertheless, Piepho (1998a) and Cornelius and Crossa (1999) showed that a wider class of shrinkage models (for AMMI or GGE or other models) can achieve even greater accuracy. Second, Piepho and Möhring (2005) explored best linear unbiased predictors that help researchers exploit both broad and narrow adaptations simultaneously for growing regions subdivided into mega-environments. Having compared several research strategies, they found that simple means within each mega-environment—which are what researchers use most frequently—are consistently the worst option because "yield data from neighboring subregions [mega-environments] may be exploited to improve yield estimates for the subregion of interest." Third, planned experiments have two designs: the treatment design that a parsimonious model such as AMMI or GGE can address, and the experimental design involving layout and replication. Overwhelmingly, the most common experimental design for yield trials is the randomized complete block design, which reduces the error mean square (and thereby increases statistical significance) but which does not adjust yield estimates closer to the true values. By contrast, better experimental designs can make adjustments that increase accuracy, including lattice and row-column designs (John and Williams, 1995), designs optimized with a spatial analysis in mind (Cullis et al., 2006; Williams et al., 2006), improved methods of analysis for individual traits such as mixed model analysis for recovery of information (Federer and Wolfinger, 1998), and geostatistical analyses (Gilmour et al., 1997). Furthermore, this opportunity to gain accuracy obtains even for single-environment yield trials, for which AMMI and GGE are inapplicable. Finally, when selection of the best genotypes or treatments is a major research objective, the numbers of genotypes, environments, and replications should be chosen carefully to optimize selection gains (Gauch and Zobel, 1996), while also satisfying any additional research requirements and constraints.

Critique of Claim 3
Regarding claim 3, we only disagree that model diagnosis is unimportant for accuracy gain, as already explained, but we agree that model diagnosis is (also) important for delineating mega-environments. Figure 5 of Gauch and Zobel (1997) is relevant in this context. As Gauch (2006a) already emphasized, a model sequence such as GGE1, GGE2, GGE3, and so on leads to different groups of mega-environments; thus, this unavoidable model choice should be guided by relevant criteria and model diagnosis.

In our opinion, the most disputable claim in Yan et al. (2007) is that "understanding the patterns in a GED [genotype x environment data] set is more important than getting some ‘accurate’ estimates." Clearly, these objectives are interrelated, with the latter being the prerequisite for the former. To understand patterns in a dataset, researchers should always require accurate estimates initially. Then they can explore the patterns by some biplot or other methods. The success of this endeavor will depend crucially on having accurate estimates.

When the sole purpose of an analysis is accurate prediction (as opposed to understanding complex GE interactions), the GGE model may have merit. For a given dataset, AMMI or GGE or EGE or another SVD-based analysis may be most accurate, as judged by the Akaike or Bayesian information criterion—although the differences are often rather small (Piepho, 1998a; Cornelius and Crossa, 1999). In the mixed model context for modeling genetic covariance between different environments, GGE is suitable (Piepho and Möhring, 2005).

In conclusion, accuracy does matter. The accuracy gain that AMMI or GGE can deliver routinely equates to having two or three times as many replications. Whereas the cost of data collection is great, the cost of statistical analysis is trivial; therefore, extra accuracy at trivial cost is a great bargain. Furthermore, given sensible mega-environments, delineated by either AMMI or GGE with appropriate model diagnosis to avoid underfitting or overfitting, past experimental results have relevance for future cultivar choices within a mega-environment. Consequently, the persistent tendency in the GGE literature to discount accuracy gain, even though GGE has just as much ability in this regard as any competitor, can only be a disservice to research practitioners.


    DISCUSSION
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
We have already responded here to Yan et al.'s (2007) review, addressing its five main topics in the same order. But several additional matters merit discussion. Gauch (2006a) critiqued the application of GGE for analyzing heterotic patterns in diallel crosses because "GGE discards the male (or else the female) main effect and then combines the other parent's main effect and the interaction effect with the presumption that the latter two effects can be reseparated satisfactorily. However, discarding one of the parent's main effects is peculiar and reseparation may be problematic." By contrast, "AMMI completely and automatically distinguishes general combining ability (for both male and female parents) and specific combining ability." But Yan et al. (2007) have not responded to that critique. Instead, they favorably cite four papers using GGE for analysis of heterotic patterns.

The most extensive critique in Gauch (2006a), which involves all three of its tables, is that interpretation of GGE2 biplots is problematic because there are nine cases (plus intermediate gradations) for how G and GE information can appear in the two axes of a GGE2 biplot. Perhaps the intended solution in Yan et al. (2007) is to restrict augmented biplots with an AEC axis to data subsets containing only one mega-environment, although no such restriction is mentioned for other GGE2 biplots. A more forthcoming response would be helpful.

Yan et al. (2007) propose sequential data subdivision using GGE2 biplots guided by formal statistical tests or imposed practical constraints to produce subsets comprising individual mega-environments. But this seems rather unsatisfactory. First, producing separate biplots for each mega-environment seems both cumbersome and unambitious. The exciting potential of an effective biplot is to reveal the overall patterns in a yield trial as a whole. Second, if GGE2 biplots are pressed into service as a classification technique, requiring numerous sequential steps and tests, researchers may question whether some long-established hierarchical classification technique would provide nicer results in a single step. Third and perhaps most important, producing cultivar recommendations for individual mega-environments considered in isolation has been shown to be remarkably inaccurate and inefficient (Atlin et al., 2000; Piepho and Möhring, 2005).

Increasingly, contemporary agricultural research to improve crops uses a combination of traditional breeding and molecular techniques. In their discussion of data centering options, Yan et al. (2007) noted that double-centered data are best "for studying gene expression data where it is the relative change of gene expression levels, as opposed to the absolute levels of the genes or of the treatments, that is the research focus"; that is, "if GE is of sole interest." We agree that AMMI is appropriate for microarray data because interest usually focuses on the differential expression of genes in the various tissues or times or whatever treatments are under study. It has also been useful with terminal restriction fragment length polymorphism analyses of extracted soil DNA to show differential changes in microbial communities associated with environmental differences (Culman et al., 2006; Thies, 2007). Furthermore, AMMI has been used in QTL scans for GE interaction (differential) effects (Romagosa et al., 1996; Emebiri and Moody, 2006; Cho et al., 2007).

Multivariate analyses such as AMMI and GGE have substantial ability to partition a signal-rich model from a noise-rich discarded residual, thereby gaining accuracy (Gauch, 1988, 2006b; Cornelius and Crossa, 1999). But other analyses, especially agglomerative hierarchical classifications, lack that ability and hence are quite vulnerable to noise (Smith and Gauch, 1992). Accordingly, a noise-susceptible analysis can be improved by first using a noice-reducing analysis like AMMI to preprocess the data, replacing the noisy actual data with model estimates from the most predictively accurate member of the AMMI model family.

Ongoing software development is critical. For instance, Gower and Hand (1996) and Gauch and Zobel (1997) showed several potentially useful kinds of graphs that are not yet implemented in any available software. Trials repeated over years have special requirements for model diagnosis and special opportunities for mega-environment delineation that need further software development. And a particularly urgent imperative is to make user-friendly software readily available to those whose crop environments are most diverse and whose food supplies are most insecure: third-world agricultural researchers. There are at least three free implementations of AMMI (Gauch, 2007; Onofri and Ciriciofolo, 2007; IRRI, 2008). Greater consensus on the best statistical methods for yield-trial analysis would be enormously beneficial because it could focus limited resources for software development on the most promising statistical analyses and graphical displays.


    CONCLUSIONS
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
The fundamental reason AMMI is appropriate for agricultural research is that the ANOVA part of AMMI can separate the G and E main effects and the GE interaction effects that present researchers with such vastly different problems and opportunities, whereas separation of G from GE is a mathematical impossibility for GGE analysis. Furthermore, the principal components part of AMMI can separate the prime, signal-rich portion of the interaction in the early components, GE', while discarding the noise-rich portion in the late components, GE*. Crop scientists focus on G and GE', whereas soil scientists focus on E and GE', while both ignore the noise in GE*. Thereby, in an integrated manner, AMMI suits interdisciplinary research teams with both crop and soil scientists. In addition, AMMI offers better opportunities than GGE for graphically displaying mega-environments and adaptive responses. The reward for effective statistical analysis of agricultural trials is faster improvement of yield, disease resistance, nutritional quality, and other important traits.


    APPENDIX
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
A GGE biplot is based on the SVD Y* = (Ip–111')Y = USV', where Y is a p x q matrix of yields of p genotypes and q environments, I is an identity matrix, 1 is a vector of ones, S is a diagonal matrix of singular values ({lambda}1, {lambda}2, ...), and U and V containing eigenvectors {gamma}gn and {delta}en, respectively, obey the conditions U'U = I and V'V = I. Let A = USz and B = VS1–z be scores for G and E, respectively, where z is a scalar determining the partition of the singular values among E and G scores, so that Y* = AB'. A GGE2 biplot is based on the first two columns of A, A2 = U2S2z (markers for G) and B, B2 = V2S21–z (markers for E), so that we may approximate Y* {approx} A2B'2.

It will now be investigated whether a GGE2 biplot can separate G from GE, and how this depends on rotation and scaling (z) of biplot axes. We first show that identification of G and GE is possible in the direction of the unrotated principal component axes. We then show that identifiability also holds for any rotation of the axes, when z = 0, but not generally otherwise. Finally, the special case of a rotation to the AEC axis is considered. In this case, G is fully captured by AEC, regardless of the choice of z, while GE can be identified only when z = 0 or z = 1, generally being split among both AEC and AEC{perp}. An important consequence is that GE is never fully captured by AEC{perp} alone.

Unrotated Principal Component Axes
The sum of squares for G (SSG) and the sum of squares for GE (SSGE) for the approximation Y* {approx} A2B'2 are given by

Formula A1[A1]
and

Formula A2[A2]
where K = q–111' and P = I K (also see Laffont et al., 2007). The SSG can be written as

Formula A3[A3]
where A2 = (a1 a2) and B2 = (b1 b2). The first two terms on the right-hand side (RHS) of Eq. [A3] correspond to the SSG for the first two unrotated axes. The last two terms always vanish, because (Harville, 1997, p. 50)

Formula A4[A4]
The same result is obtained for SSGE by replacing K with P = I K. These results show that G and GE can be separated in the direction of the principal axes, regardless of the choice of z.

Orthogonally Rotated Axes
Consider an orthonormal rotation matrix {Omega} = (o1 o2), which rotates G and E scores according to A2 {Rightarrow} A2{Omega} and B2 {Rightarrow} B2{Omega}, respectively. The SSG based on the rotated axis scores becomes

Formula A5[A5]
The first two terms on the RHS of [A5] correspond to the SSG for the first two rotated axes. The last two terms vanish when z = 0, because in this case, A'2A2 = I and hence

Formula A6[A6]
and

Formula A7[A7]
This shows that the contribution of an axis to SSG can be identified when z = 0, which corresponds to environment-focused partitioning SVP = 2 in Yan et al. (2007). When z != 0, this result will not generally hold (a special case, where identifiability holds, occurs for the rotation to AEC; see below). The same kind of derivation can be made for SSGE by replacing K with P.

Rotation to AEC and AEC{perp}
We next turn to the special case where the coordinate system is rotated such that the first axis coincides with AEC. First note that KB2 = 11'B2 = 1c', where c' = 1'B2 is the vector of AEC coordinates. Thus, SSG can be written as

Formula A8[A8]
This is proportional to the sum of squares of projections of G markers onto the AEC axis, given by the inner product of A2 (G markers) and c (AEC). Note that this result holds regardless of the choice of z, so the projection onto AEC recovers all G in the GGE biplot, regardless of the partition of singular values among environments and genotypes (choice of z).

The same result for SSG is obtained from the general results for rotated axes in the previous section on orthogonally rotated axes. The cosine and sine of the angle between the first principal component and AEC are

Formula A9[A9]
Thus, the rotation matrix that rotates G scores A2 and E scores B2 from the original coordinates to those of AEC and AEC{perp}, is given by

Formula A10[A10]
With this particular rotation, we have (for any z)

Formula A11[A11]
It follows that SSG in the rotated coordinate system with axes AEC and AEC{perp} is

Formula A12[A12]
because the other three trace terms in Eq. [A5] involve the term KB2o2 and thus vanish. This shows that AEC, being associated with o1, captures all SSG in the GGE biplot. The result holds for any z.

The SSGE in the rotated coordinate system with axes AEC and AEC{perp} is

Formula A13[A13]
The last two terms on the RHS of [A13] vanish when z = 1. This is now shown for the third term, which can be rewritten as

Formula A14[A14]
The last term in [A14] has already been shown to vanish for any z. It is readily verified that

Formula A15[A15]
where d = b'11 and e = b'21. We have M = 0 when z = 1 (SVP = 1 in Yan et al., 2007), whence trace(A2o1o'1B'2B2o2o'2A'2) = trace(A2MA'2) = 0. Thus, the third term on the RHS of [A14] vanishes. The same can be shown for the fourth term on the RHS of [A13]. Thus, we have

Formula A16[A16]
This proves that AEC and AEC{perp} allow identification of SSGE also when z = 1. It is also evident that SSGE is always split between both axes; that is, SSGE is never entirely captured by AEC{theta}{perp} alone.

Does AEC{perp} Maximize the Contribution to SSGE?
Contributions to SSGE are identifiable for arbitrary rotations only when z = 0, so we consider only this case. The rotation o1 that maximizes the contribution of the second rotated axis to SSGE, trace(o'2B'2PPB2o2), must minimize the contribution to the first axis, trace(o'1B'2PPB2o1). Defining o1 = [±{theta}, {surd}(1 – {theta}2)] it can be shown that computation of the first derivative of trace(o'1B'2PPB2o1) with respect to {theta} and equating to zero yields a quadratic polynomial in {theta}2 of the form

Formula A17[A17]
where

Formula A18[A18]
Thus, the rotation minimizing trace(o'1B'2PPB2o1) is obtained as one of the two solutions for {theta}2 of Eq. [A17]. Obviously, neither of these two solutions equals the AEC.


    ACKNOWLEDGMENTS
 
We appreciate helpful suggestions on earlier versions of this paper from Scott Ebdon, Cajo ter Braak, and two anonymous reviewers. We also thank Martin Wells for helpful discussions about identifiability in the GGE model.


    NOTES
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 
All rights reserved. No part of this periodical may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording, or any information storage and retrieval system, without permission in writing from the publisher. Permission for printing and for reprinting the material contained herein has been obtained by the publisher.

Received for publication September 18, 2007.


    REFERENCES
 TOP
 NOTES
 ABSTRACT
 INTRODUCTION
 MODELS AND TERMINOLOGY
 MEGA-ENVIRONMENT DELINEATION
 GENOTYPE EVALUATION
 TEST-ENVIRONMENT EVALUATION
 ANALYZING GENOTYPE AND GENOTYPE...
 MODEL DIAGNOSIS AND ACCURACY...
 DISCUSSION
 CONCLUSIONS
 APPENDIX
 REFERENCES
 




This article has been cited by other articles:


Home page
Crop Sci.Home page
M. Varela, J. Crossa, A. K. Joshi, P. L. Cornelius, and Y. Manes
Generalizing the Sites Regression Model to Three-Way Interaction Including Multi-Attributes
Crop Sci., October 22, 2009; 49(6): 2043 - 2057.
[Abstract] [Full Text] [PDF]


Home page
Crop Sci.Home page
L. Pecetti, P. Annicchiarico, C. Porqueddu, A. Khedim, and A. Abdelguerfi
Fitting Germplasm Types of Tall Fescue and Orchardgrass to Different Cropping Environments of the Mediterranean Region
Crop Sci., October 22, 2009; 49(6): 2393 - 2399.
[Abstract] [Full Text] [PDF]


Home page
Crop Sci.Home page
R.-C. Yang, J. Crossa, P. L. Cornelius, and J. Burgueno
Biplot Analysis of Genotype x Environment Interaction: Proceed with Caution
Crop Sci., August 7, 2009; 49(5): 1564 - 1576.
[Abstract] [Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Figures Only
Right arrow Full Text (PDF) Free
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Gauch, H. G.
Right arrow Articles by Annicchiarico, P.
Right arrow Search for Related Content
PubMed
Right arrow Articles by Gauch, H. G., Jr.
Right arrow Articles by Annicchiarico, P.
Agricola
Right arrow Articles by Gauch, H. G.
Right arrow Articles by Annicchiarico, P.
Related Collections
Right arrow Plant and Environment Interactions
Right arrow Crop Genetics
Right arrow Statistics


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
The SCI Journals Agronomy Journal Vadose Zone Journal
Journal of Natural Resources
and Life Sciences Education
Soil Science Society of America Journal
Journal of Plant Registrations Journal of
Environmental Quality
The Plant Genome