Playbook: Temporal Recovery
Temporal is the brain of our remediation orchestration. If it fails, all autonomous actions stall.
1. Database Connectivity
Problem: Temporal cannot connect to Postgres.
Resolution:
- Check Postgres logs:
docker compose logs postgres.
- Ensure migrations have completed:
docker compose logs temporal.
2. Worker Death
Problem: Remediation worker crashed.
Resolution:
- Restart the service:
make dev-up.
- Temporal will automatically deliver the current task to the new worker. Execution is guaranteed to resume from the last successful state.
3. Workflow Termination
If a workflow is truly stuck due to a logic bug:
- Terminate it via the UI (
localhost:8233).
- Fix the bug, rebuild images, and restart the system.