How to edit the directory?

This description is about the listed methods and their evaluations seen in the Topics and Methods parts. If you want to join the discussion in the Forum, feel free to join the mailing list, and send any message that is in line with the aim of the mailing list.

Who can edit the directory?

Only professionals working in the numerical cognition area can edit the directory and can vote on the methods.

Technical implementation of the directory

Technically, the directory can be edited in a gitlab project (, not in the public site directly ( The information from the gitlab project is then processed and transferred to the public website by an automatic script. (Note that for the first month, the script will not run automatically, so it might require a few hours or days, until your edits will be visible on the public site.) The gitlab project site is visible only for the editors, while the public website is visible for anyone.

The gitlab project technically uses two parts:

How to register for editing?

To edit the directory (i.e., to add new methods and to comment and vote on those methods), a gitlab account should be sent to the admins:

How to edit the directory?

Anyone with editing access can add methods, review a method and vote on it. All editings and votes are public. There is no hidden part of the directory.

The editor interface of the directory is available at

Should/can I add a method?

Adding methods

Add the method to the methods (issue) part:

  1. Open a new issue
    • To open a new issue, go to the Issues part (menu on left), click on New issue (top right).
  2. Add the brief description and reference of the method – the same text can be copied here from the wiki part.
    1. Click on “Choose a template” and choose method_description.
    2. Add a title
    3. Add the description - use the template form
      • Describe the method briefly, usually in only a few sentences.
      • Add the appropriate reference where the method is described in details, e.g., journal paper, book chapter, preprint, etc. Use either the APA style citation (e.g., simply use: Moyer and Landauer, 1967) or the APA style reference (e.g., Moyer, R. S., & Landauer, T. K. (1967). Time required for Judgements of Numerical Inequality. Nature, 215(5109), 1519–1520., and always add either a DOI or a URL when available, so the reference should be straightforward and one click away for the readers.
      • Add the authors of the list (the list of the authors should be a separate paragraph beginning with “Authors:”)
    4. To format the text, use the toolbar at the top right part of the Content area, or check the description at the Markdown link below the Content area. Check the preview if it looks OK.

Add the method to the wiki page:

  1. Find the appropriate topic wiki page, or if it does not exist, create the appropriate new page.
    • To create a wiki page, go to the Wiki category (menu on left), click on New page button (top right), add a name for the page, and click on Create page.
    • If you create a new wiki page, add a link to the new page from the Home wiki page. (For example, click on Wiki on Numerical cognition > Numerical cognition methods Editor > Wiki above the current wiki page, which brings you to the Home page, and edit it).
  2. Add the link to the method part (appropriate issue)
    • To edit the appropriate wiki page, click on the Edit button (top right).
    • Add the number of the appropriate issue with a hash sign before it, e.g., #23. (You can find this number, e.g., in the address bar, when you see the issue.) GitLab will transform it to a link automatically.
    • Check the Preview (above the Content editing part) if it looks OK, then click on Save changes (bottom).
    • This link to the issue will be transformed in the public version, and readers will see the title of the issue.

Review a method and vote on it

In the review,

You can combine these types of comments in any way, but clearly, it does not make sense to ask about some essential component of the method, and vote on it at the same time.

Technically, all of these notes should go to the Issues part of the gitlab project.

Commenting about a method

  1. Find the method you want to review in the issue tracker (find the link from the wiki pages or use the GitLab search function).

  2. If you want to write a review which is a new review, and not a response to some previous review, then go to the bottom of the page, and in the Write part, write your review.
    • You can use the formatting bar or Markdown to format your text. Use the Preview tab to check how your text will look.
  3. When the text is ready, use the arrow next to the Comment text, and choose Start discussion. (Others can reply to your review only if you choose the Start discussion option, otherwise, with the Comment option your review will be standalone comment.

  4. If you want to mainly reply to a previous review, then look for that review, and start typing in the Reply field.
    • You can use the formatting options as described above.
    • Click on Comment when ready.

If you added a review-like comment for a published journal or conference paper, you might add your post-publication review to your Publons account, too. Go to your Private Dashboard, choose the Peer reviews menu on the left, click on the Add a review button, choose Post-publication review option, set the article DOI or other article details that identify the article, paste your review to the Review Content (you can use the same Markdown syntax as in the GitLab interface), and click on the Create Review button (see also the Publons description). You might add the link of your review on to the review text on Publons.

Voting on a method

A vote is technically a comment (so all information above applies here, too) with some extra rules.

When you vote, start your comment with the support or oppose words. After that, you can add any other comment, but the first word should be “support” or “oppose”. If you don’t use these words as the first word of your comment, your comment is not a vote, even if your comment supports or opposes the method. Also, if you +1 or -1 the method, it is not a vote, only the first word “support” or “oppose” in your comments are votes.

You can’t vote on your own method (i.e., you’re one of the authors of the publication of the method). Still, you can add other comments to your work (such as responses to questions, additional details, etc.), but not a vote.

If you are somehow related to any of the authors of the method you are voting on, add a disclaimer to your vote what is your relation to the authors. (E.g., the author of the method is my wife; the first author of method was my boss between 2008 and 2016; I have a paper with the third author as co-author.)

If you vote on a method, it is appreciated if you add some justification why you support or oppose the method. This is especially important, if you oppose a method.

If you ask about an essential detail in your comment, then it does not make sense to vote on it at the same time.

The status of the methods will be updated continuously and automatically, depending on the actual numbers of supportive and opposing votes. See the details here.