Say what the score is meant to do

Suppose a study uses a proposed NSI score to rank journal entries by how likely they are to contain a documented deviation from a written trading plan. The first question is whether entries with a deviation tend to rank higher. A separate question arises if a researcher translates the score into a probability, such as 60 percent. The calibration question is whether an outcome occurs approximately that often across comparable cases assigned that probability. A methodological tutorial by Huang and colleagues illustrates the distinction. [1]

Give the two checks different columns

Imagine a held-out set with two groups of 50 entries. The method assigns the higher-rated group a 60 percent chance of deviation and the lower-rated group a 30 percent chance. Suppose the observed counts are 20 and 10, or 40 and 20 percent respectively. The ordering of these group averages is consistent with the estimates, while the probabilities exceed the observed frequencies in both groups. That example says nothing about rankings within each group, how uncertain the proportions are, or performance in another sample.

Keep the measurement claim as narrow as the study

Set the event definition before the review and show the count behind every frequency. Use a written definition of what the journal outcome means and a separate set of records for evaluation. Treat the example as a research design exercise for a proposed framework. It supplies no evidence of clinical validity or trading performance.

The Gold Nervous System Indicator by Gabriel Nicolaev – CyGuru
EXPLORE THE RELATED BOOK

The Gold Nervous System Indicator

Discover the connection between the human factor and gold trading.

Discover the book ↗Read the book overview →

Sources & further reading

  1. Huang and colleagues’ calibration tutorial ↗

Sources consulted 15 November 2026. Editorial frameworks and illustrative examples are identified within the text.

CONNECTED PROJECTS

Take the next step.

NSI.GOLD ↗Explore the proposed Nervous System Indicator framework and its research questions.
More in Gold & Trading →Editorial principles