> ## Documentation Index
> Fetch the complete documentation index at: https://laminar.sh/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Troubleshooting Agent Evaluations

Fixes for the most common problems when running [agent evaluations](https://laminar.sh/docs/agent-evaluations/introduction.md) with `lmnr-cli eval run`.

> [accordion] A change to the app or the image doesn't show up
>
> `lmnr-cli` rebuilds the `lmnr.yaml` images on every run, but Docker's layer cache can still hide a change, for example a `RUN` step that downloads "latest". Check the file inside a running container, then clear the cache with `docker builder prune` or bump a cache-busting `ARG` placed before the stale step.

> [accordion] A service won't start as root
>
> Some services, such as Postgres, refuse to run as root. Start them as a service user with `gosu` or `su`, and make sure that user can write the log directory (`chmod 777 /logs/agent`).

> [accordion] The app can't see an env var from harbor.yaml
>
> `agents[].env` reaches every command the agent runs. If the start script launches the app with `env -i`, it must forward each name explicitly.

> [accordion] The trial trace has no LLM or tool calls
>
> Either the app isn't instrumented with Laminar, or it didn't receive `LMNR_TRAJECTORY_PATH`. See [Capture the trajectory](https://laminar.sh/docs/agent-evaluations/trajectories.md).

> [accordion] Job output shows \[REDACTED] in odd places
>
> A secret's value is very short, so every occurrence of it in the output is redacted. Use long, distinctive placeholder values.

> [accordion] Where are the logs for a failed trial?
>
> For local runs, in `evals/<suite>/jobs/<timestamp>/`. For `--remote` runs, Harbor's job output stays in the sandbox: open the trial's trace in Laminar instead.
>
> Each local trial has `agent/` (your logs and `result.json`), `verifier/` (`reward.txt`, `test-stdout.txt`), and `exception.txt` with the agent's traceback if it raised.

## Next steps

> [card] [Run evals with lmnr-cli](https://laminar.sh/docs/agent-evaluations/running-evals.md)
>
> Local and remote modes, flags, CI, and sandbox limits.

> [card] [Capture the trajectory](https://laminar.sh/docs/agent-evaluations/trajectories.md)
>
> Get the app's LLM and tool calls into every trial's trace.

> [card] [Write the agent and verifier](https://laminar.sh/docs/agent-evaluations/agent-and-verifier.md)
>
> Drive the entry point, wait for a terminal state, and grade the result.

> [card] [Harbor integration](https://laminar.sh/docs/integrations/harbor.md)
>
> Already running `harbor run` on a benchmark? Add the Laminar plugin directly.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.