- +northline_support_runworkflow
- +triage_agentagent
- +lookup_customertool
- +gpt-5.5-2026-04-24llm
- +knowledge_agentagent
- +search_kbtool
- +resolution_agentagent
- +create_refundtoolPII in Outputs
neatlogs investigates.
You review the fix
neatlogs gathers the evidence, finds what caused the failure, and prepares a fix brief your coding agent can act on. You review it like a pull request.
Findings go where your team already works:
Every issue starts with
the evidence attached.
However an issue appears, neatlogs connects it to the production evidence before the investigation begins.
A detection fired
A condition, pattern, PII check, or classifier flagged the exact span where the behavior appeared.
An eval failed
A person or AI evaluator judged an output against your standard, and it did not clear it.
@neatlogs refunds are failing again for Northline. Can you check the latest run?
I found the matching production run and attached the reported outcome.
run_1842 · create_refund · 503Someone reported it
A customer or teammate flagged the outcome in Slack, Discord, email, or Intercom. neatlogs connects their words to the run they describe.
create_refund returned 503
Retry budget exhausted after three attempts.
neatlogs noticed
It found a failed tool call, broken execution, or suspicious behavior without waiting for an external trigger.
Evidence becomes a case
Now neatlogs
works the case.
Most tools give you a failed trace and somewhere to start reading. neatlogs investigates across everything already known about the issue.
Amara Osei
Refunds are failing again for Northline. The latest customer was outside the return window.
Ravi Menon
I found the same outcome on another enterprise account. Both runs skipped escalation.
You get one report.
With 4 things your team needs.
Root cause
ConfirmedEvidence and reasoning
12 linkedRecommended action
ReadyVerification
3 checksRoot cause
What actually went wrong, stated clearly enough to put in a ticket.
Evidence and reasoning
The spans, comparisons, business rules, and observations supporting the conclusion.
Recommended action
The specific change to make: a prompt, tool description, workflow step, retrieval strategy, or guardrail.
Verification
The cases to test and the production behavior to watch after the change ships.
Review it. Ship it. neatlogs sees if it held
Bring the investigation to your team, hand a bounded fix brief to your coding agent, and keep watching the same failure path after the change ships.
The refund path continued after the policy lookup returned an exception.
@neatlogs this account is in the enterprise exception group. Did the run load that policy?
Good catch. I found a second policy lookup and added it to the evidence.
Discuss the evidence
Comment on the report, challenge the reasoning, and bring in the person who knows the full context.
Require escalation before enterprise refunds
Prevent `create_refund` when the account policy requires a specialist review.
- Evidence
- 4 spans + report
- Acceptance
- 3 verification cases
Create the ticket
Send the issue to Linear or Jira with the report linked and its severity, evidence, and acceptance criteria intact.
Gate refunds behind policy escalation
Change only the decision path used by `resolution_agent`.
- Root causeException result ignored
- Relevant spanslookup_policy → create_refund
- ExpectedEscalate before tool call
- Verify3 supplied regression cases
Send it to your coding agent
Give Claude Code, Cursor, or another MCP-compatible agent the root cause, relevant spans, expected behavior, and verification cases instead of an entire trace dump.
Customer replied“The account was upgraded yesterday.”
Policy exception was missing.
UpdatedStale account tier caused the wrong policy to load.
Investigate again
Re-run the analysis when a customer replies, a teammate adds context, or new evidence changes the case.
Enterprise refund guard
Watching the same failure path in production.
Watch the fix
neatlogs monitors your agent in production, and re-surfaces the issue if it returns.
Detections find. Evals judge.Investigations diagnose.
Each layer answers a different question about production behavior.
What happened during this run?
Where did a known condition or behavior appear?
Why did it happen, and what should change?
Did the behavior meet an explicit standard?
Product questions and answers
The practical details about issues, investigation evidence, recommendations, and verifying the fix.
What’s an issue?
An issue is a flagged problem in an agent’s behavior. It carries a severity, a source, and the runs it belongs to. Issues come from a fired detection, a failed eval, a person reporting something, or neatlogs raising one on its own.
An issue is a flagged problem in an agent’s behavior. It carries a severity, a source, and the runs it belongs to. Issues come from a fired detection, a failed eval, a person reporting something, or neatlogs raising one on its own.