> ## Documentation Index > Fetch the complete documentation index at: https://docs.neuroncx.in/llms.txt > Use this file to discover all available pages before exploring further. # Set Up Your Institution's Eval Flags > Choose which eval flags your institution uses, add your own, and change or switch them off. Eval flags mark replies from the bot that had a problem. Your institution uses two kinds: * **Platform flags**: set up by NeuronCx and raised automatically when a reply is graded. * **Your own flags**: flags you add for problems that matter to your institution, for example a scan booked as a home collection. This page is for admins. To review the conversations that were flagged, see [Review Eval Flags](https://docs.neuroncx.in/observe/review-eval-flags). > [!NOTE] > > Only people from your own institution can change your institution's flags. ## Open the Eval flags list **1. Open Setup, Flags** Open **Setup** and click the **Flags** tile. Two tabs open: **Transaction flags** and **Eval flags**. Click **Eval flags**. ![07 Setup Flags Tile](https://mintcdn.com/neuroncx/bozgmrXHW7V2JBzS/images/07-setup-flags-tile.png?fit=max\&auto=format\&n=bozgmrXHW7V2JBzS\&q=85\&s=008a5ff08a072eff0b88f078cd9891ac) The Flags tile in Setup **2. Read the list** The list shows every eval flag your institution uses. Platform flags come first, then your own. * **Flag**: the name, with its code in grey underneath. * **What it means**: the description the grader uses to decide when to raise it. * **Severity**: High, Medium or Low, with a coloured dot. * **Status**: **On** or **Off**. Next to **+ Flag** you can see how many of your own flags are on, for example "6 of 15 judge flags on". Only the table scrolls, so the buttons stay in view. The three platform flags are **Answer not backed by content**, **Off-topic answer** and **Missing content**. You cannot rename them, but you can change their severity and switch them on or off. ![08 Setup Eval Flags Tab](https://mintcdn.com/neuroncx/bozgmrXHW7V2JBzS/images/08-setup-eval-flags-tab.png?fit=max\&auto=format\&n=bozgmrXHW7V2JBzS\&q=85\&s=ce029359d55e8281b4880df0648745ad) The Eval flags tab ## Add your own flag **1. Click + Flag** The new flag window opens. **2. Name the flag** Type a **Name** between 3 and 60 characters, for example "Scan booked as home collection". **3. Describe what should be flagged** Under **What should be flagged**, describe the problem in a sentence or two, and say when it should not be raised. Use between 10 and 500 characters. The counter under the box shows how many you have used. **4. Choose a severity** Pick **High**, **Medium** or **Low**. It starts on Medium. **5. Choose On or Off** Leave the switch **On** to start using the flag, or turn it **Off** to save it for later. **6. Click Create** The new flag appears at the end of the list. NeuronCx makes a short code from the name. The code never changes, even if you rename the flag later. ![09 New Flag Dialog](https://mintcdn.com/neuroncx/dbXFQAKDV4cGLk7q/images/09-new-flag-dialog.png?fit=max\&auto=format\&n=dbXFQAKDV4cGLk7q\&q=85\&s=0656f6f05904b1f1dee4e682c0763816) The new flag window **Create** stays grey until the name and the description are long enough. A red message under the box tells you how many characters are missing. ![Red message under What should be flagged with Create greyed out](https://mintlify.s3.us-west-1.amazonaws.com/neuroncx/images/eval-flags/11-description-too-short.png) The description is too short > [!WARNING] > > Do not use `@` or `##` in the name or the description. The grader reads this text and does not accept these characters. > [!NOTE] > > A new flag only applies to conversations graded from now on. Conversations graded earlier are not checked again. For the grader to look for your own flags, NeuronCx must switch this on for your institution once. ## Change a flag Click the pencil icon on the flag's row. * **Your own flags**: you can change the **Name**, the description, the **Severity** and the switch. * **Platform flags**: the name and description are greyed out, with the note "The name and meaning of this flag are set by the platform. You can change its severity and switch it on or off." You can still change the severity and the switch. The small grey line "Code: ... (does not change)" shows the flag's code. Click **Save**. If you changed nothing, the window just closes. **Cancel** closes it without saving. Severity changes show in Observe straight away, including on conversations that were already flagged. ![10 Edit Platform Flag](https://mintcdn.com/neuroncx/dbXFQAKDV4cGLk7q/images/10-edit-platform-flag.png?fit=max\&auto=format\&n=dbXFQAKDV4cGLk7q\&q=85\&s=d68b68c1f584dba570e9c8fa101add84) Editing a platform flag ## Switch a flag off There is no delete. To stop using a flag, open it with the pencil icon, switch it **Off**, and click **Save**. * The flag stops being raised on new conversations. * It no longer shows in the counts, lists and filters in Observe. * It stays in your list as **Off**, so you can switch it on again at any time. > [!WARNING] > > You can have at most 15 of your own flags **On** at the same time, and 40 in total. The grader gets slower and less accurate with more. ## Flag stages | Stage | What it means | | - | - | | **On** | The flag is raised on new conversations and counted in Observe. | | **Off** | The flag is not raised and is hidden from the counts. You can switch it on again. | Severity is High, Medium or Low. Your institution decides how serious each flag is, and the colours are the same everywhere in the console. ## If something looks wrong | What you see | What it means | | - | - | | **Create** or **Save** is greyed out | The name is under 3 characters, or the description is under 10. Read the red message under the box. | | "You already have a flag with this name" | Names must be different within your institution, whatever the capital letters. Choose another name. | | "At most 15 judge flags can be on at a time. Switch another one off first." | Switch one of your flags off, then try again. You can also save the new flag with the switch **Off**. | | "At most 40 judge flags can be defined" | You have reached the limit. There is no delete, so reuse a flag you no longer need by changing its name and description. | | "This flag has no description, so the judge cannot apply it" | A flag needs a description before it can be switched on. Add one and save. | | "The name cannot contain @ or ##" | Remove those characters from the name or the description. | | "Sign in again: ..." or "This agent does not belong to this institution, so the change cannot be saved" | Your session no longer matches your account. Sign in again. If it keeps happening, ask your admin. | | The list does not load and shows a red message | Click **Try again**. If it keeps failing, ask your admin. | | You added a flag but it never shows on conversations | The flag needs to be **On**, the conversations must be graded after you added it, and NeuronCx must have switched on your own flags for your institution. | ## Related pages > [card] [Review Eval Flags](https://docs.neuroncx.in/observe/review-eval-flags) > > Find flagged conversations and resolve the flags. > [card] [Admin Console](https://docs.neuroncx.in/getting-started/admin-console.md) > > Other platform settings for admins. This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.