Reading the Numbers

Reading the Numbers

A few rules decide how Game Analytics counts. Knowing them helps you read the figures correctly.

Who Is Counted

  • Figures are for one game version at a time, and for the players the filter bar selects.
  • The design team (the game's owner and designers) is left out unless you include it.
  • Players of abandoned instances are left out unless you include them; players of terminated instances always are.
  • If the game requires consent, players without it are left out. Each panel says how many players were left out, and why.

Questions and Quizzes

  • A pass counts. A player who failed a question and then answered it correctly counts as correct.
  • Only graded questions have a correct answer. A question with no correct answer in its design (e.g. a survey question) gets no correct/incorrect figures and no difficulty.
  • Empty answers are skipped, not answered, and option shares are computed over the players who chose something.
  • Difficulty is the share of players who answered correctly: 0.9 means an easy question, 0.3 a hard one.
  • Quiz scores count only players who completed the quiz: an unfinished attempt is not a low score.
  • Discrimination tells you whether a question separates strong players from weak ones. It compares how the top 27% of players (by quiz score) and the bottom 27% did on the question: close to 1, the strong players got it right and the weak ones did not; around 0, it makes no difference; below 0, weak players did better, which usually means the question is misleading or its correct answer is wrong. It needs at least 5 scored players, and it is unreliable for small groups.

Times

  • Times are measured on each player's device clock, from their first recorded action in the game.
  • Figures such as time to reach and time spent are medians: half the players took less, half took more. Medians are not thrown off by a player who left the phone on a bench for an hour.
  • The game keeps only the latest record of each element (e.g. the last time a player entered a scene), so an element a player came back to is timed at the return.

Up to Date

Figures are computed when you open a panel, from the players' current game states, and cached briefly. Refresh recomputes them.