Skip to content
Judgment Labs
Esc
↑↓navigate↵open⌘Jpreview
On this page

Slack Agent

Ask @Judgment about your agent from Slack.

The Slack Agent is turned on per organization. If @Judgment replies that the Slack Agent isn’t enabled for your organization, contact support to turn it on.

Once your organization connects Slack:

  • Judgment posts alerts from judge actions, issue reports from Issues, and reports from Scheduled Tasks to your channels.
  • If the Slack Agent is on for your organization, it answers when you mention @Judgment in a thread or DM it.

Connect Slack

An org admin or owner connects Slack once in Settings, then Connections; see Connections.

Project setup has the same step (Slack, “Keep your team in the loop”, reopened from Project guide in the Support menu), where you connect Slack and choose the channels that get issue reports.

Ask @Judgment

@Judgment runs the same agent as the in-app Judgment Agent, with the same tools: it can query your traces and labels, read and edit judges, and read Issues. For the lunch-order agent:

@Judgment which restaurants had get_menu failures in the last 24 hours, and how many orders did they affect?

There’s no default project. Unless you name one, a thread isn’t tied to any project, so say which project you mean. To point a thread at one project, start the message with --project and the project name:

@Judgment --project lunch-order-agent were there more Negative sessions this week than last week?

If the name doesn’t match a project, it tells you and stops. Use quotes for names with spaces: --project "Lunch order agent". Once a thread has a project, it keeps it. To use a different project, start a new thread.

The Slack Agent doesn’t show approval cards, so it makes changes without asking. Be specific when you ask it to create or edit something, like a judge action, and check the result in the app.

Thread replies

Whether the agent needs a mention to answer in channel threads is an org setting; see Slack Agent replies. DMs never need a mention.

If something looks wrong

  • If @Judgment doesn’t reply, check that Slack is connected in Connections and that @Judgment is in the channel. If it replies that the Slack Agent isn’t enabled, contact support.
  • If it answers about the wrong project, start the message with --project <name>.
  • If no alert arrived, check the action’s condition, frequency and cooldown. See If an action didn’t run.

Was this page helpful?