Shuichiro Ogawa
日本語

Notes

Research, experiments, and reflections on AI and design, published along with the process of making them.

Back to the monthly list

Research and writing methods (18)

How to frame research questions and write papers.

  • What the Classic Japanese Writing Guides Teach: Nine Books Turned into Procedures and Checklists

    2026-11-10

    This note summarizes what nine books regarded as classics of Japanese writing instruction teach, and turns their advice into procedures and checklists ordered by the stages of writing. The nine books are three writers' guides titled Bunshō tokuhon (Tanizaki Jun'ichirō 1934, Mishima Yukio 1959, Inoue Hisashi 1987), five books on composition technique (Shimizu Ikutarō 1959, Iwabuchi Etsutarō ed. 1960, Honda Katsuichi 1976, Kinoshita Korekazu 1981, Todayama Kazuhisa 2022), and one critique of the bunshō tokuhon genre (Saitō Minako 2002). Only Tanizaki's book, whose copyright term has ended, was read in full text; the other books were described from their tables of contents, publishers' descriptions, and university lecture materials that quote them. The writers' guides train sensibility and close reading, whereas the composition books set checkable rules with the reader's understanding as the goal. The two groups agree on economy of words but divide on whether to state things plainly. Tanizaki lists 'not trying to make things too clear' as a condition of dignity, while Kinoshita devotes a chapter to 'the attitude of stating things clearly.' However, Tanizaki explicitly excludes specialized academic writing, so the two instructions collide only in general practical writing such as letters.

  • A Scan for Research Gaps in Past Notes (2026-10, Fifteen Lenses)

    2026-10-11

    This note records a scan in which fifteen lenses for finding research gaps (a thread on X by Hamidullah Khan, 2026-10-09, reorganized as the research-gap-lenses skill) were applied to the corpora of 87 academic notes. From 27 candidates, 10 were selected, and for each of them the nearest existing studies were searched externally in an attempt to break its novelty. The verdicts were: likely unanswered for 2 candidates (appropriate reliance in design judgments without a correct answer, and why AI images are preferred together with the shift of standards through familiarity), partly answered for 6, an extension for 1 (transferring to visual design the finding that LLM feedback becomes more lenient when the maker claims authorship), and a replication opportunity for 1 (reproducing a 1998 experiment that separated the consistency of appearance from the consistency of operation). The 6 partly answered candidates were rewritten by narrowing the question to what remains after excluding the range answered by the nearest studies (Lima et al. 2025, Shin et al. 2025, Fan and Chang 2026, and others). Of the 27 candidates, 17 were dropped because of overlap with earlier work, distance from the main axis, or a high likelihood of being answered already. Across the whole corpus, two kinds of research were thin: the temporal dimension (delayed tests, repeated exposure, longitudinal follow-up) and studies that separate the mechanism of an effect at the level of the process. The paper ideas are handed over to paper-pipeline.

  • How a Claim of Novelty Is Verified, Defended, and Written: From Pre-Submission Checks to Bundles of Papers

    2026-09-26

    A literature note that answers two questions (how authors verify and defend a claim of novelty before submission and during review, and in what order a paper should be decided and written) from evidence-based research in medicine, peer review research, official documents of academic societies and of publication norms, the economics of priority, evaluations of LLM novelty checks, and editors' essays and research on the writing process. It collects 88 items, 76 scholarly works (including one preprint) and 12 official documents, and uses 67 of them in the body. On the side of verification, since RCTs cite a median of only 21% of prior trials (Robinson & Goodman) and a protocol-driven search picks up only 30% of primary sources (Greenhalgh & Peacock), it shows that "to the best of our knowledge" is no more than a declaration of the scope searched. On the side of judgment, it confirms that reviewers speak of originality as seven kinds of newness (Guetzkow et al.), that agreement between reviewers stays at ICC .34 and κ .17 (Bornmann et al.), and that even at PLOS ONE, which is supposed to look only at validity, evaluations shift with proximity in the coauthorship network (Teplitskiy et al.). Society rules explicitly trade novelty against effectiveness and reliability (IEICE) and change the criteria by manuscript type (JSSD). Scooped teams receive 21% fewer citations (Hill & Stein), and quality falls the more competitive the topic, so the date of a preprint and scoop protection become means of defense. LLM novelty checks misjudge known concepts as novel, and 24% of generated proposals were paraphrases of existing research. On the side of writing, the seeds of rejection are sown at topic choice (Colquitt & George), the process of writing itself finds the claim (Galbraith), and rebuttals barely move final scores (Gao et al.). Finally, it sets out the checks to run before submission and the way to plan the writing as a procedure, with supporting literature attached to each step.

  • Where Are the Seeds of Novelty Found? Surprise, Rereading, and Novelty That Is Only Apparent

    2026-09-26

    A literature note that examines under what conditions the expectation that "even a topic that seems to lack novelty will yield novelty if you change your point of view" holds, and under what conditions it ends in novelty that is only apparent, drawing on empirical studies of where and how researchers find the seeds of novelty and on methodological literature about rereading a topic. It collects 81 scholarly works and uses 64 of them in the body. On where seeds come from, it shows that successful scientists integrate activities outside research with their research (Root-Bernstein et al.), that people positioned across groups produce ideas that are more often judged good (Burt), while being at the margin does not by itself predict innovation (Gieryn & Hirsh), and that novelty produced by underrepresented groups is taken up less by later research (Hofstra et al.). Serendipitous discovery divides into four types and four mechanisms (Yaqub), and noticing occurs as a discrepancy from expectation, yet six of the seven responses to anomalous data protect the existing theory (Chinn & Brewer). It organizes the operations of rereading into seven (splitting constructs, changing the context, changing the level, reading the same data with a different procedure, changing the operationalization, going back to the phenomenon, and defamiliarizing), and pairs each with the conditions under which it ends as mere appearance. Job satisfaction and organizational commitment correlate at .91 once measurement error is corrected (Le et al.), the correlation between foreign birth and illiteracy is .118 for individuals but −.526 across states, reversing its sign (Robinson), and the odds ratios of 29 teams analyzing the same data ranged from 0.89 to 2.93 (Silberzahn et al.). It places the operations of changing one's view in the variation stage of the cycle of variation and selection (Fiedler), and shows for each operation the check to pass in the selection stage. Finally, it presents a ten-step procedure, from writing down expectations first to checking against the field's literature, with supporting literature attached to each step.

  • Writing Material for a Review Article: The Assumption Ledger and Nearest-Neighbour Literature Left by 17 Novelty Audits

    2026-08-09

    A note that reworks, as writing material for a review article, the record of narrowing 20 paper candidates extracted from a 117-item wiki corpus down to 5 qualitative studies, then generating 12 challenges by assumption reversal (problematization), and subjecting all 17 to external novelty audits. The audits returned 0 items intact, 12 that survive with qualifications, and 5 that are substantively already published, confirming that the novelty of an empirical paper lies not in an unclaimed finding but only in empirical execution within a specific field. Following this verdict, the centre of gravity shifts to a review article, and for the three writable proposals (a scoping review of LLM-as-a-Judge and creativity evaluation, a critical review of the assumptions underlying research on AI and the creative professions, and an integrative review bundling the conditions under which harm occurs) it sets out the research questions, where the contribution is placed, the actual size of the existing corpus, methodological conventions, remaining work, and target venues. As an analytical framework it presents an assumption ledger of 45 items across four fields (AI and design practice, generative AI and learning, the evaluation and measurement of creativity, and design process research and methodology) in five layers, and collects by field the nearest-neighbour literature identified in the audits as evidence for positioning the review. 88 references (with DOI or URL; 7 of them explicitly not verified against the primary source).

  • Extracting candidates for peer-reviewed papers: a cross-wiki analysis that excludes the author's own theory

    2026-08-09

    A research-strategy note that extracted 20 candidates at the grain of a peer-reviewed paper, examining four clusters (epistemology and methodology, education and learning, profession and industry, evaluation and creativity) and limited to the themes among the 117 wiki/note entries that do not depend on the author's own theory. The candidates are graded by maturity: A (nearly ready to write) for 5, B (skeleton in place) for 11, and C (idea stage) for 4, and the note recommends an order of submission. An addendum narrows the list to 5 qualitative research candidates and adds a novelty audit through external literature searches (intact / survives with limits / substantially pre-empted) and proposals for reframing.

  • How Novelty Is Made and How It Is Claimed: A Typology of Establishing Strategies

    2026-07-28

    A literature note that collects, across fields, the strategies for establishing novelty, starting from the question of what operations can actually be moved in response to a demand to produce novelty. It organizes 243 items across eight traditions: problematization research in management studies, heuristics of discovery in the philosophy of science, scientometrics, rhetoric and genre analysis, contribution taxonomies in HCI and design research, the extension and falsification of theory, analogy and boundary crossing, and idea generation in the age of LLMs. It first establishes that strategies split into two kinds—generation (making novelty) and claiming (asserting novelty)—and that the two have been conflated. On the generation side it shows that the assumptions open to challenge divide into five layers (Alvesson & Sandberg), that naming one's ignorance and strategically choosing one's materials are different strategies (Merton's specified ignorance and strategic research materials), that mechanism discovery reduces to decomposition and localization (Bechtel & Richardson), that there is a path by which a tool becomes a theory outright (Gigerenzer), and that atypical combinations work only when built on a base of high conventionality (Uzzi et al.). On the claiming side it shows that Move 2 of CARS is exhausted by four steps—counter-claiming, gap-indicating, question-raising, and continuing a tradition (Swales)—and that hype words have roughly doubled over fifty years and appear in about 97% of successful NIH applications (Hyland & Jiang; Millar et al.). Few strategies have had their effects verified quantitatively, and many of those that have collide with the inverted-U preference of evaluators (Criscuolo et al.) and the distance penalty (Boudreau et al.). 96 references.

  • Where Do Novel Research Questions Come From? The Four Loci and Their Combinations, Examined Against the Literature

    2026-07-28

    A literature note that examines a practitioner's hypothesis—that the only places where a paper's novelty can reside are Related Work, Problem Definition, Materials, Methods, and Results, and that securing two or more of the four loci left after Related Work makes a paper strong—against 135 items across five traditions: problematization research in management studies, scientometrics, philosophy and sociology of science, contribution taxonomies in HCI and design research, and genre analysis of academic English. No scholarly formulation that normatively maps IMRaD sections onto types of contribution was found, so the note first establishes that the four-locus classification stands on its own as practitioner knowledge. It then shows that each locus has an independent lineage (Problem Definition = problematization and specified ignorance; Materials = strategic research materials and experimental systems; Methods = tools-to-theories), that Related Work is not a locus of generation but a locus of claiming corresponding to Move 2 of CARS, and that at the Results locus a design that wins by scale cannot be conflated with serendipity. On the prescription of two or more loci, it sets Uzzi's atypical combinations, Shi and Evans's contents and contexts, and Arts and Veugelers's familiarity and novelty on the supporting side alongside Boudreau's distance penalty, Criscuolo's preference for the moderate, Johnson and Proudfoot's variance in evaluation, and Zhao et al.'s 2026 disconfirming measurement (results-based novelty alone is cited more than holding all three dimensions), and makes explicit, as a gap, that no peer-reviewed evidence directly measuring combinations of loci exists. 78 references.

  • Gaps in AI Research, a Fourth Time: Seen from Outside the Inversion Family

    2026-07-21

    An essay that rereads the three sibling notes that searched for gaps in AI research (the seven frames, the A–G operational sheet, the game board of Problem Definition) from the vantage of the full set of problem-setting methods now assembled. It shows that all three generators belong to a single family of operations—binary inversion—and that they had been converging on that family's fixed points (an endogenous scaling law, the institution of recording). On that basis it applies operations that lie outside the family. Morphological analysis (GMA) makes the board's constants orthogonal as dimensions and yields an unvisited intersection cell (a single system that is recursive and ecological and longitudinal at once); TRIZ turns the incompatibilities that cannot be inverted (cultural diversity versus universal human rights; individual novelty versus collective homogenization) into design problems solved by separation; PSM/CATWOE restores the demoted cognitive diversity and non-Western epistemologies as 'another board' and points to the absence of a method for adjudicating the plurality of boards; and Cynefin and representational change diagnose the infinite regress all three fall into not as a defect but as a misclassification of the type of problem situation. On the single point that convergence may be a property of the family of operations more than of the object, it weakens the earlier three notes' argument from 'the convergence of independent generators.' The three gaps that the operations outside the family pointed to were checked against the coverage of recent (2024–2026) prior work, and each was judged partial (a residue can be narrowed against a dense body of prior work). References augmented across method, evidence, and coverage-confirmation studies.

  • AI Research Gaps, a Third Time: Rereading Them as Rewritings of the Game Board

    2026-07-20

    An essay that rereads the two sister notes that searched for gaps in AI research (the catalogue of seven frames, and the revisit via the A-through-G worksheet) with a third generator: Problem Definition (operations on the game board). It writes out AI research's game board, with sources, in seven entries (certification of success, measurement, unit, endpoint, position of observation, noise, record-keeping institution) and selects the three most unnatural asymmetries from what was pushed off the board. It maps each of the seven frames to the board operation it was, showing that symmetry inversion is one species of board rewriting (an operation specialized to an asymmetric pair). It retries the two candidates demoted in the revisit note (cognitive diversity and non-Western epistemologies, and the self-mapping of blind spots), makes explicit that the demotion was a certification by the A-through-G worksheet's own success-certifying apparatus (falsifiability and the minimal observable), and reinstates them as questions strong under a different type while upholding the determination of kind. It confirms that applying the conversion table to scaling laws comes out at the same void as the endogenous scaling law, taking the convergence of independent generators as weak evidence that the void is not an artifact. Finally it generates two problem statements and RQs whose units are the success-certifying apparatus and the record-keeping institution (both gap candidates whose coverage by prior work is unchecked), and closes with the division of labor between generators (Problem Definition generates; A-through-G vets). 17 references.

  • Thinking in Problem Definition: Rereading the Game Board of Existing Research

    2026-07-20

    Relocates the strength of research from 'the ability to produce good answers' to 'the ability to see through what is being counted as a problem,' and organizes the craft of Problem Definition, which operates on the observation apparatus, evaluation axes, time horizon, units, and boundaries (the game board) that existing research implicitly fixes. Presents ten patterns easy to transfer, a 14-row meta-conversion table that maps existing research onto questions, a five-step generation protocol that lowers a description of the board into a problem statement and an RQ, and five habits of thought, connecting them to the lineage of the contrast between gap-spotting and problematization (Sandberg & Alvesson), problem setting (Schön), problem finding (Getzels & Csikszentmihalyi), ill-structured problems (Simon), and wicked problems (Rittel & Webber). 10 references.

  • AI Research Gaps, Revisited: Sorting Symmetry-Completion from Coverage, and Digging Out an Endogenous Scaling Law

    2026-07-20

    A revisit of the seven frames catalogued earlier, using a sharpened discipline (a procedure that lowers a premise, inverts a symmetry, and operationalizes it across an A-through-G worksheet). The same discipline is turned on its own past product to select, strengthen, and generate blind spots. Selection yields three groups: the single strongest candidate whose every slot fills (the relational ontology of capability), four that survive as symmetry-completion frames, and two that fail the symmetry test and are demoted (cognitively diverse users with non-Western epistemologies, and self-mapping of blind spots). Demotion is not disqualification but a determination of kind: legitimate fairness-and-coverage concerns that are not symmetry-completion blind spots. The discipline then generates one new blind spot. It inverts the open-loop assumption that a scaling law treats its input distribution as exogenously fixed, and formalizes a closed loop in which a model's capability produces its future data, an endogenous scaling law. Novelty is limited strictly. Model collapse, self-consuming loops, and scaling laws parameterized by the synthetic-data fraction are all prior work; what remains new is only inverting the exogeneity of the input distribution itself, so the data fraction becomes an endogenous state variable that closes the loop. 24 references (21 with confirmed bibliography, 3 flagged for primary verification).

  • The Vanishing of Knowledge: Undiscovery as the Dual of Discovery

    2026-07-19

    A note that inverts, with the symmetry-completing move by which de Broglie derived matter waves, the asymmetry whereby science and its meta-science measure only the production of knowledge and treat loss as accident or noise. The inversion says that the vanishing of knowledge (undiscovery) is a process dual to discovery, with its own mechanisms and a measurable rate of loss. Agnotology, the study of deliberately manufactured ignorance, serves as the 'light quantum' shown on one side; the completion extends loss into a general, rate-bearing process and binds production and loss into a single ledger. This symmetrization is offered not as an established fact but as a falsifiable hypothesis, with two predictions: a measurable undiscovery rate and a loss-adjusted progress metric. Novelty is strictly limited to the symmetrization itself and the loss-adjusted meta-science; the description of individual loss phenomena is prior art and is credited by name. 22 references (20 confirmed, 2 with unreached full text flagged for primary verification).

  • Where Are the Gaps in AI Research? Seven Voids Found by Reframing

    2026-07-19

    An essay that searches for AI's unexplored territory not through the open problems surveys enumerate (deductive gap-finding) but through the leap of reframing, inverting a field's taken-for-granted premises (the abduction-2 of Dorst and Peirce). It raises seven frames—stationarity, research reflexivity, ecology, the asymmetry of non-knowledge, cognitive diversity, the monism of epistemology, and the field's own blind spots—and presents the gap each frame reveals as a conditional hypothesis. In every section it names existing partial research (model collapse, emergent norms in LLM populations, decolonial AI, the systematization of the reproducibility crisis) to narrow each gap precisely, from 'wholly unexplored' to 'the absence of an integrative methodology' or 'an asymmetry of institutionalization.' 45 references (36 with confirmed bibliography, 9 carrying a primary-source-verification caveat for partial bibliography or unreached full text).

  • Methods and Validity in Design Research: A Literature Map of Case Study, Research through Design, and Mixed Methods

    2026-07-19

    A literature map organizing the methodological foundations of knowledge generation through artifacts and practice-based research, drawing on established public sources. Five themes—case study design (Eisenhardt 1989, Yin 2014), Research through Design and constructive design research (Frayling 1993, Zimmerman et al. 2007/2010, Koskinen et al. 2011), securing validity and reliability (Cook & Campbell 1979, Lincoln & Guba 1985), generalizing from cases (Flyvbjerg 2006, Yin's analytic generalization), and integrating quality and quantity in mixed methods (Tashakkori & Teddlie 2010, Creswell & Plano Clark 2011)—are described not to advocate one position but to show how these frameworks divide the labor of answering. 10 references (all in English).

  • Analyzing the Making Process and Its Contextual Supports: A Literature Map of the Critical Incident Technique, Reflective Writing, and Design Education History

    2026-07-19

    Organized around the question of how to record and analyze the making process and reflection on it, this note reviews three methodological lineages neutrally: the critical incident technique (Flanagan 1954), the design of structured reflection (Ash & Clayton's 2009 DEAL model), and the quality assessment of reflective writing (Ullmann 2019), attending to differences in collection design and unit of analysis. As contextual support it adds the quality assurance of literature reviews (Boote & Beile 2005 and others) and historical cases of environments that cultivate an exploratory disposition (the Bauhaus preliminary course, organizational slack-time programs). The organizational slack-time cases are handled with their low academic rigor and success bias made explicit. 11 reference footnotes (the Bauhaus note bundles 3 works).

  • Is the Primacy of Qualitative Methods in Design Research Academically Mainstream?

    2026-07-15

    The conclusion of the preceding note (qualitative-quantitative-design-research) -- that the exploratory character of design is epistemologically consonant with qualitative research -- occupies a mainstream position in design research since Frayling (1993), Cross (2006), and Dorst (2011). A bibliometric analysis of fifteen years of Design Studies (Chai & Xiao 2012) corroborates the predominance of qualitative methods. Three countervailing tensions nevertheless persist: the quantitative orientation of HCI (the experimental norms of CHI), the quantitative tradition of evidence-based design, and the call by Gaver (2012) and Koskinen et al. (2011) to transcend the qualitative-quantitative dichotomy altogether. A research agenda centered on 'how evaluation affects people's willingness to try again' and 'designing conditions that enable a second attempt' harbors a methodological tension: qualitative methods are needed to describe those conditions, yet some form of empirical verification is required to assess whether altered conditions produce the intended effects. This tension cannot be bridged by mixed-methods pragmatism alone; a mechanism-oriented epistemology such as critical realism (Bhaskar 1975) emerges as a candidate framework.

  • Qualitative and Quantitative Research: In the Context of Design

    2026-07-15

    An overview of the epistemological foundations, strengths, and limitations of qualitative and quantitative research, along with guidelines for methodological choice in design research. Design is an exploratory activity that envisions and realizes what does not yet exist (Simon 1969; Schon 1983; Cross 2006). Because of this character, qualitative methods (ethnography, protocol analysis, case studies, research through design) are called for at the exploratory stage, while quantitative methods (usability testing, surveys, experiments) are needed at the evaluative stage. Mixed methods research provides a framework that methodologically secures the continuity between these two stages within a single study.