Shuichiro Ogawa
日本語

Notes · updated 2026-08-02

Adversarial Review of Two Generative Art Surveys: Examining the Literature Map and the Citation Strategy Against the Design-Theory Canon

Scope and Method

This note integrates the results of an adversarial review of two notes, generative-art-literature (the 94-item literature map) and generative-art-review-citation-strategy-literature (the bibliometric analysis of citation-earning angles), conducted with the critical-review skill (lens: design-theory; since the lens could not be determined uniquely from the request, the project default design-theory was adopted). The critiques were carried out independently by two academic-critic agents (canon: design-theory) in full compliance with the critique protocol (claim inventory, Evidence Ledger, steelman, load-bearing assumptions, disconfirming evidence, falsifier, non-convergence). The reference canon is Simon, Schön, Cross, Dorst & Cross, Buchanan, Rittel & Webber, Krippendorff, and Costanza-Chock, following the convention of citing both the supporting and the opposing sides. The full critiques (including the Evidence Ledgers) are stored in source/review/generative-art-adversarial-review/; this note integrates the points that passed acceptance review.

Let us first delimit the character of the critique. Both critiques acknowledge the integrity of the two target notes’ collection and tabulation (full provenance with retrieval dates for every item, self-declared limitations, zero fabrication) and are directed at the leaps of interpretation and argumentation that remain nonetheless. The bibliographic verification work (the 31 items in total that both notes self-declare as [primary source verification needed]) is a remainder of confirmation tasks, not a suspicion of fabrication, and is not at issue in this review.

Target 1: Criticisms of the Literature Map (94 Items)

Acknowledged Strengths (Steelman)

Before criticizing, the target’s claims were reconstructed in their strongest form. The “four generations” of the technical genealogy remain a proposed reading rather than an assertion, and the note itself records the fraying of the linear history (the bridging studies of Wu & Adar and of Broad). The sixty-year-invariance thesis, which runs the “evaluations drop when the machine is known” pattern from Noll 1966 to the present, works rather as an antidote to linear history, by making visible what does not change and resisting absorption into the narrative of generational technical succession. The six gap claims are honestly limited to the range of the sample, as “could not be confirmed in this corpus.”

Weakness 1: Entanglement of AI’s Ontological Status

The note treats AI as a tool in the technical-genealogy chapter, as a co-designer (a locus for the distribution of authorship) in the McCormack-side authorship debate, as an environment (an autonomous system) in the Galanter definition, and as a stimulus for label effects in the reception studies, with its positioning shifting chapter by chapter. In particular, the arrangement that juxtaposes Hertzmann’s “tool” argument and Galanter’s “autonomous system” argument as the two poles of authorship contains a leap: it presents two claims at different ontological levels (an instrumental reading and an environmental reading) as an opposition on a single axis. The tool argument and the autonomous-system argument may not be two answers to the same question but answers to different questions.

Weakness 2: The Unsorted Concept of “Generation”

The note runs procedural generation (form generation from rules), evolutionary computation (generation under selection pressure), deep generative models (sampling from a distribution), and text-to-image (language-conditioned generation) through the same “generation,” without conceptually distinguishing whether it is the traversal of a search space, fitness judgment, or extraction from a learned distribution. If it is to be used for the chapter structure of a review article, this distinction should be the hinge that connects Chapter 2 (technology) and Chapter 3 (theory).

Weakness 3: The Leap of Inferring Absence from a Sample

The move from “could not be confirmed in this corpus” to the disciplinary proposition of “a disconnect between theory and empirical work” does not distinguish omissions produced by the collection design from absence as a fact about the field. Because the collection ran four profile streams in parallel premised on the chapter structure, bridging studies that cross chapters are structurally hard to capture. A sample of 94 items can demonstrate within-chapter coverage, but it is unsuited to demonstrating the absence of cross-chapter mutual citation.

Weakness 4: Compression of the Definition’s Semantic Change

The note applies the opening Galanter-type definition (delegation to an autonomous system) to the whole of 1958–2026, but the word “generative” differs in semantic content between the generative Ästhetik of 1965 (rule-based generation in information aesthetics) and the text-to-image of the 2020s (language-conditioned distribution sampling). While the note itself describes the emergence of generative Ästhetik in Chapter 1, treating that term and the modern “generative” as continuous under a single definition is an operation that grafts a conceptual-historical semantic change onto a single lineage.

Objections to the Genealogical Construction from Art History and Media Theory

The media-archaeological criticism that a linear history of technical progress produces a “victors’ genealogy” and renders parallel histories invisible (Huhtamo & Parikka [citation needed]) partially applies to the construction of Chapter 1. The construction that places the Stuttgart School as the canonical origin puts Zagreb’s New Tendencies in a subordinate clause, leaves Vera Molnár in the references, and compositionally marginalizes the lineages of women artists and of the non-Western world. The critique, however, qualified this point: the note records the political implications of Zagreb through Klütsch and the fissures inside the movement through Taylor and Nake, so the marginalization is a compositional imbalance of emphasis, not a concealment of sources.

Conflating Wicked and Tame

Measured against Buchanan’s wicked problems (1992), all six gap claims are formulated in the vocabulary of “fillable holes” (tame lacunae), but “what should protection technologies rest on” and “the divergence in measuring labor effects” are not lacunae that adding samples would fill; they are conflicts over problem-setting itself. Placing tame lacunae (the missing coverage of Japanese copyright law) and wicked disputes on the same plane leads the review article’s open-problems section to mistake the nature of the disputes.

Target 2: Criticisms of the Citation-Strategy Analysis

Acknowledged Strengths (Steelman)

The citation-strategy note can be read as strategic intelligence that carried out “circulation prediction” with verifiable public data, and it serves as a rational aid to Simonian satisficing (topic selection under limited resources). In particular, the gap discovery at the core of the top-ranked angle (the unconnected state of computational-creativity evaluation frameworks and the LLM empirical corpus, backed by the self-acknowledgment of the nearest review, Franceschelli & Musolesi 2024) holds value independently even if the citation prediction fails. The critique itself limited its scope: “the substance of the gap discovery and the limited usefulness as circulation prediction cannot be overturned.”

Weakness 1: The Slide from Citation Prediction to Research Value

The note’s methods section separates “the ease of earning citations” from “the value of the topic,” but this qualification is effectively removed by the No. 1 verdict of the integrated ranking. Measured against Schön’s critique of technical rationality (1983), this is a structure that delegates “what ought to be asked” (problem-setting) to the citation market, a choice that unknowingly takes Simon’s side in the Simon–Schön dispute. The choice of position is itself possible; what becomes the weakness is that it is not made explicit.

Weakness 2: Age Bias in the Metric and Extrapolation to Oneself

While the corpus’s limitations section admits that the delay distribution of citations has not been corrected for, the main text makes citation velocity the primary metric of comparison. A growth rate such as +607% is unstable at a low base count (42→297). And the induction that infers the future citations of one’s own paper from the measured citations of others’ papers is an extrapolation in which the population and the target differ; the bibliographic data do not warrant the validity of this extrapolation.

Weakness 3: The Exhaustiveness Slide

“No review exists” is, in the methods section, a claim limited to the range of the search terms, but the No. 1 verdict of “no competition” effectively removes this qualification. The accurate statement is “not captured by the recorded search terms within the English-language paper space of OpenAlex/S2”; non-paper forms of criticism, exhibition catalogs, and artist discourse escape the net in principle. The fact that De Rooij’s 2025 meta-analysis had already erased one gap before the writing, as the note itself mentions, is a concrete instance of this timing risk.

Weakness 4: Survivorship Bias

“Highly cited surveys are equipped with taxonomy and open problems at 7/7” is an observation sampled only from the highly cited group and cannot rule out the possibility (the denominator) that lowly cited surveys share the same structure. Elevating this 7/7 to a constitutive requirement without a control group is a leap that reinterprets an external count as a necessary condition.

Weakness 5: The Implication Leap of the “Re-citation Node”

The core logic of the No. 1 ranking (“the Boden/SPECS group is stably cited at a cumulative 3,850 citations, therefore a new review can relay those citations”) does not entail that later authors who cite the theory group will also cite the new review. Readers can simply cite Boden directly; to be relayed requires, separately, a synthesis not obtainable from direct citation (the provision of a new framework). The cumulative citation count of the existing theories does not predict the success of that synthesis.

Disconfirmation of the Critique of Metric-Driven Topic Selection (Limiting the Critique’s Scope)

The critique also examined the strongest rebuttal to its own criticism. In Mertonian sociology of science, citation is an institutionalized token of recognition by the community of experts [citation needed], and citation prediction can be justified as an anticipation of “what the community deems valuable.” The empirical scientometrics literature (Royle 2013, Tahamtan 2016) also supports the stability of the predictors of citation. Therefore, what the critique can overturn is only the equation “citation prediction = research value” and the implication leap of “citation interception”; using the metrics as reference information is itself not overturned.

Cross-Cutting Findings: Assumptions the Two Notes Share

The suspicions about shared assumptions that the two critiques reached independently coincide. First, both notes share the assumption that “citation data and search-term coverage are objective traces,” but measured against Costanza-Chock’s Design Justice (2020), citation counts are institutional products constructed by evaluation infrastructure (database coverage, anglophone bias, field-specific citation practices), not neutral traces. The undercounting of humanities work, books, and non-English material that both notes self-declare is at once a technical defect and a concrete instance of the politics of evaluation infrastructure. Second, the compositional operations “organizable into four chapters” and “rankable down to seventh place” both contain the same type of transformation: fitting wicked disputes into a tame frame.

Two conclusions that must not be adopted from a design-theory standpoint were also settled. “Label effects have been invariant for sixty years, therefore the aesthetic evaluation of machine-generated artifacts has a stable cognitive structure” is a universalism that treats the cultural constitution of the evaluating subject as invariant, and is not adopted. “Since the citation-attracting angle has been identified, it should be given priority in writing” is an outsourcing of problem-setting, and is not adopted.

Unresolved Disagreements (Disagreement Table, Excerpt)

The critiques were not converged; the disagreements were left standing together with the evidence needed for adjudication. Of the nine axes in total, the six major ones are listed here (the full table is in the full critiques).

Axis of disagreementPosition A (source)Position B (source)Evidence needed for adjudication
Does the technical genealogy represent the history of practice?Legitimate as a history of the expansion of the means of search (Simon 1969)Conceals the co-evolution of problem and solution (Dorst & Cross 2001)Whether there are cases in which the transformation of the questions and the transformation of the technology moved independently
Is the sixty-year-invariance thesis a legitimate diachronic observation?Evidence of the robustness of a mode of knowing (Cross 1982)Hides the assumed invariance of the evaluating subject’s cultural constitution (Costanza-Chock 2020)The task isomorphism between Noll’s experiment and modern label-effect experiments, and the sameness or difference of the subject populations
The defining axis of generative artDelegation to an autonomous system (Galanter 2003)Meaning-making (Krippendorff 2006)Whether the value of the generated artifact can be explained by the generating mechanism
Is citation a proxy for research value?An institutionalized token of recognition (Mertonian [citation needed] / Royle 2013)A single scale that reinterprets the wicked as tame (Buchanan 1992 / Rittel & Webber 1973)Empirical evidence of agreement between high citation and expert quality assessment
May problem-setting be delegated to metrics?Legitimate as satisficing (Simon 1969)The error of technical rationality (Schön 1983)A comparison of the ex post scholarly contribution of metric-driven versus question-driven topic selection
Can a “gap” be confirmed exhaustively?Approximable through exhaustive search termsThe web of representation misses tacit and non-paper knowledge (Cross 1982)The reproducibility agreement rate of gap judgments across independent searchers and databases

Revision Guidelines the Review Settled

With the disagreement table left standing, only the revisions that both critiques concur in demanding are listed.

  1. The literature map should have a section that makes explicit the distinction among AI’s ontological statuses (tool / co-designer / environment / evaluation apparatus) and should reposition the tool argument and the autonomous-system argument as “answers to different questions.”
  2. The literature map’s gap section should notate tame lacunae and wicked disputes separately.
  3. The citation strategy’s integrated ranking should state the qualification that it is “a predicted ranking of citation demand” and not “a ranking of what ought to be written,” not only in the methods section but also in the synthesis section.
  4. Replace every occurrence of “no competition” with “could not be confirmed within the range of the recorded search terms.”
  5. Rewrite the “re-citation node” logic by decomposing it into the gap discovery (valid) and the expectation of citation relay (unsupported).

Unverified Items

The [citation needed] and [primary source verification needed] markers newly attached by this review total 24, all of which are bibliographic confirmations of the doctrinal grounds on the critiques’ side (the 31 items originating from the two target notes are consolidated in their respective notes and are not repeated here).

  1. The relevant pages and chapters of the canon literature (Simon 1969, Schön 1983, Cross 1982/2006, Dorst & Cross 2001, Buchanan 1992, Rittel & Webber 1973, Krippendorff 2006, Costanza-Chock 2020, Norman 1988/2013): the page references for all critical points are memory-based and require primary confirmation before citation (14 items in total)
  2. The bibliography of Huhtamo & Parikka 2011, Media Archaeology, and the relevant passages of the parallel-histories argument (outside the canon; confidence low)
  3. The primary source of the gap-spotting critique (Sandberg & Alvesson)
  4. The specific work, year, and pages for the Mertonian sociology-of-science claim that “citation = institutionalized recognition”
  5. The relevant clauses and DOI of Hicks et al. 2015 (the Leiden Manifesto), and the relevant clauses of DORA 2013
  6. The page ranges and DOI notation of Buchanan 1992, Rittel & Webber 1973, and Dorst & Cross 2001 (memory-based figures)
  7. The reachability of the Galanter 2003 URL (relies on the target note’s record; unverified on the critique side)

References

The doctrinal grounds of the critiques. The confirmation status of pages and chapters is as given under “Unverified Items” above (the DOIs listed are standard known ones; entries marked [citation needed] are memory-based from the critic agents).

  1. Simon, H. A. 1969/1996. The Sciences of the Artificial. MIT Press. https://mitpress.mit.edu/9780262691918/the-sciences-of-the-artificial/
  2. Schön, D. A. 1983. The Reflective Practitioner: How Professionals Think in Action. Basic Books. https://www.basicbooks.com/titles/donald-a-schon/the-reflective-practitioner/9780465068784/
  3. Cross, N. 1982. Designerly Ways of Knowing. Design Studies 3(4): 221–227. https://doi.org/10.1016/0142-694X(82)90040-0
  4. Cross, N. 2006. Designerly Ways of Knowing. Springer. https://doi.org/10.1007/1-84628-301-9
  5. Dorst, K.; Cross, N. 2001. Creativity in the design process: co-evolution of problem–solution. Design Studies 22(5): 425–437. https://doi.org/10.1016/S0142-694X(01)00009-6
  6. Buchanan, R. 1992. Wicked Problems in Design Thinking. Design Issues 8(2): 5–21. https://doi.org/10.2307/1511637
  7. Rittel, H. W. J.; Webber, M. M. 1973. Dilemmas in a General Theory of Planning. Policy Sciences 4(2): 155–169. https://doi.org/10.1007/BF01405730
  8. Krippendorff, K. 2006. The Semantic Turn: A New Foundation for Design. CRC Press. https://doi.org/10.4324/9780203299951 [citation needed]
  9. Costanza-Chock, S. 2020. Design Justice: Community-Led Practices to Build the Worlds We Need. MIT Press. https://doi.org/10.7551/mitpress/12255.001.0001
  10. Norman, D. 1988/2013. The Design of Everyday Things. Basic Books. https://www.basicbooks.com/titles/don-norman/the-design-of-everyday-things/9780465050659/
  11. Huhtamo, E.; Parikka, J. (eds.) 2011. Media Archaeology: Approaches, Applications, and Implications. University of California Press. [citation needed]
  12. Hicks, D.; Wouters, P.; Waltman, L.; de Rijcke, S.; Rafols, I. 2015. The Leiden Manifesto for research metrics. Nature 520: 429–431. https://doi.org/10.1038/520429a
  13. DORA. 2013. San Francisco Declaration on Research Assessment. https://sfdora.org/read/
  14. Galanter, P. 2003. What is Generative Art? Complexity Theory as a Context for Art Theory. GA2003, Milan. https://www.philipgalanter.com/downloads/ga2003_paper.pdf [primary source verification needed]

Primary materials under critique (the complete bibliographies are in each note’s references): generative-art-literature (94 items), generative-art-review-citation-strategy-literature (63 items). Full critiques: source/review/generative-art-adversarial-review/critique-1-literature-map.md, critique-2-citation-strategy.md (containing the full Evidence Ledgers, load-bearing assumptions, falsifiers, and non-convergence sections in full).


← All Notes · Home