Notifications

    The bell in the top bar: the ten kinds of notification it collects, how to get from an item to the run, trace or rule it is about, and how mark read works.

    After this page you can find out what happened while you were away and get to the run, trace, queue or rule it happened on in one click — and you know which events reach the bell and which also reach your inbox.

    The bell

    The bell sits in the top bar of every project page and shows a badge with your unread count (capped at 99+), refreshed every 30 seconds while the tab is visible. Opening it lists your notifications newest first — Unread only by default, Show all for history — each with its kind, title, a one-line body and time. Clicking an unread row marks it read and follows the stored link; Mark all read clears the badge without deleting anything. Notifications are per person: marking yours read never affects a colleague’s.

    The ten kinds

    KindWritten whenWho receives itLinks to
    Mentiona comment mentions youthe mentioned members, minus the authorthe comment on its trace, span, session, run or row
    Alert firedan alert rule firesorganization Owners and Admins, plus the addresses on the ruleAlerts › History
    Monitor signala monitor detects an anomaly or regressionthe sameAlerts › Monitors
    Budget pausedan online rule reaches its daily judge budgetOwners and AdminsEvaluations › Online rules for that Environment
    Run completeda run you started finishesthe run’s creatorthe run
    Simulation finisheda simulation run you launched endsthe creatorthe run
    Review assigneditems are assigned to you in a review queuethe assigneesAnnotate › the queue
    Access requesteda non-member asks to join the organizationOwners and AdminsOrganization › Members
    Usage thresholdan Environment passes 80% or 100% of the monthly span allowanceOwners and AdminsPlan and usage
    Plan changeda platform admin changes the organization’s planOwners and AdminsPlan and usage

    A notification is written by the event that caused it and never fails that event: a run completes whether or not its notification could be stored. Pass rates in a notification read no verdict when null, never 0%. Alerts, monitors and usage notices also go out by email and Slack — see Alerts — and the bell is additive to those channels, never the only one.

    Limitations

    • The badge polls; an item can be up to 30 seconds late.
    • The list is person-wide across every organization and project you belong to, with no scope filter, so one click can move you into another project.
    • There are no per-kind mute or digest preferences, and no mark-as-unread: a row read by accident is found again under Show all.

    EvalKit is built by Syntropylabs. Published on PyPI and npm.