Tags

PC members and administrators can attach tag names to papers. It’s easy to change tags and to list all papers with a given tag, and ordered tags preserve a particular paper order. Tags also affect color highlighting in paper lists.

Tags are visible to the PC and hidden from authors. Twiddle tags, with names like “#~tag”, are visible only to their creators. Tags with two twiddles, such as “#~~tag”, are visible only to PC chairs.

Finding tags

A paper’s tags are shown like this on the paper page:

Tags [Edit] Edit
#earlyaccept

To find all papers with tag “#discuss”:

 

You can also search with “show:tags” to see each paper’s tags, or “show:#tagname” to see a particular tag as a column.

Tags are only shown to PC members and administrators. Additionally, twiddle tags, which have names like “#~tag”, are visible only to their creators; each PC member has an independent set. Tags are not case sensitive.

Changing tags

  • For one paper: Go to a paper page, select the Tags box’s “Edit” link, and enter tags separated by spaces.

    [Tag entry on review screen]

  • For many papers: Search for papers, select them, and use the action area underneath the search list. Add adds tags to the selected papers, Remove removes tags from the selected papers, and Define adds the tag to the selected papers and removes it from all others.

    [Setting tags on the search page]

  • With search keywords: Search for “edit:tag:tagname” to add tags with checkboxes; search for “edit:tagval:tagname” to type in tag values; or search for “edit:tags” to edit papers’ full tag lists.

    [Tag editing search keywords]

  • In bulk: Administrators can also upload tag assignments using bulk assignment.

Although any PC member can view or search most tags, certain tags may be changed only by administrators.

Tag colors

Tags “red”, “orange”, “yellow”, “green”, “blue”, “purple”, “gray”, and “white” act as highlight colors. For example, papers tagged with “#red” will appear red in paper lists (for people who can see that tag). Tag a paper “#~red” to make it red only on your display. Other styles are available; try “#bold”, “#italic”, “#big”, “#small”, and “#dim”. The settings page can associate other tags with colors so that, for example, “#reject” papers appear gray.

Tag values and discussion orders

Tags have optional numeric values, which are displayed as “#tag#100”. Search for “order:tag” to sort tagged papers by value. You can also search for specific values with search terms like “#discuss#2” or “#discuss>1”.

It’s common to assign increasing tag values to a set of papers. Do this using the search screen. Search for the papers you want, sort them into the right order, select their checkboxes, and choose Define order in the tag action area. If no sort gives what you want, search for the desired paper numbers in order—for instance, “4 1 12 9”—then Select all and Define order. To add new papers at the end of an existing discussion order, use Add to order. To insert papers into an existing order, use Add to order with a tag value; for example, to insert starting at value 5, use Add to order with “#tag#5”. The rest of the order is renumbered to accommodate the insertion.

Even easier, you can drag papers into order using a search like “editsort:#tag”.

Define order might assign values “#tag#1”, “#tag#3”, “#tag#6”, and “#tag#7” to adjacent papers. The gaps make it harder to infer conflicted papers’ positions. (Any given gap might or might not hold a conflicted paper.) The Define gapless order action assigns strictly sequential values, like “#tag#1”, “#tag#2”, “#tag#3”, “#tag#4”. Define order is better for most purposes.

The autoassigner has special support for creating discussion orders. It tries to group papers with similar PC conflicts, which can make the meeting run smoother.

Examples

Here are some example ways to use tags.

Skip low-ranked submissions. Mark low-ranked submissions with tag “#r1reject”, then ask the PC to search for “#r1reject”. PC members can check the list for papers they’d like to discuss anyway. They can email the chairs about such papers, or remove the tag themselves. (You might make the “#r1reject” tag chair-only so an evil PC member couldn’t add it to a high-ranked paper, but it’s usually better to trust the PC.)

Mark controversial papers that would benefit from additional review. PC members could add the “#controversial” tag when the current reviewers disagree. A search shows where the PC thinks more review is needed.

Mark PC-authored papers for extra scrutiny. First, search for PC members’ last names in author fields. Check for accidental matches and select the papers with PC members as authors, then use the action area below the search list to add the tag “#pcpaper”. A search shows papers without PC authors.

Vote for papers. The chair can define tags used for allotment voting. Each PC member is assigned an allotment of votes to distribute among papers. For instance, if “#vote” were a voting tag with an allotment of 10, then a PC member could assign 5 votes to a paper by adding the twiddle tag “#~vote#5”. The system automatically sums PC members’ votes into the public “#vote” tag. To search for papers by vote count, search for “rorder:vote”. (Learn more)

Rank papers. Each PC member can set tags indicating their preference ranking for papers. For instance, a PC member’s favorite paper would get tag “#~rank#1”, the next favorite “#~rank#2”, and so forth. The chair can then combine these rankings into a global preference order using a Condorcet method. (Learn more)

Define a discussion order. Publishing the order lets PC members prepare to discuss upcoming papers. Define an ordered tag such as “#discuss”, then ask the PC to search for “order:discuss”. The PC can now see the order and use quick links to go from paper to paper.

Mark tentative decisions during the PC meeting using “#accept” and “#reject” tags, or mark more granular decisions with tags like “#revisit” or “#exciting” or “#boring”. After the meeting, use Search > Decide to mark the final decisions. (Or just use the per-paper decision selectors.)